MEMORANDUM  33 


iO 

rH 

IQ 

00 

w 

N 


SENSITIVITY  OF  THE  KALMAN  FILTER  WITH  RESPECT 
TO  PARAMETER  VARIATIONS 


Distribution: 

Gardiner 
Dressier 
Me ier\ 

Ho  \ 
Kashiw&ji 
KecklerV 
Korsak  \ 
Lombard  \ 
Luenbergea 
Ratner  1 


Davidson,  NXPO 
Montgomery, /NX  PO 
Smith,  NXPO.  \ 
Wells,  NXPO 
Young,  NXPO 


Salmon 
Won/ 
Eikelman 
Fraser 
/abrof  f 
'Albritton 
Belote 
Roscher 
Weinstein 
Branch 


D  O  C 

•  . --n  n 

p'r  ■ 
we **  '9I 


'  \0 
V^J> 


Prepared  by: 

B.  L.  Ho 

Research  Engineer 

Information  and  Control  Laboratory 

March  1968  •  ( 


Project  5188-303 

Raproducftd  by 

NATIONAL  TECHNICAL 
INFORMATION  SERVICE 

tprln«ll(M,  V*.  22151 


SRI-H-8-984 

K.T 


UNCLASSIFIED 


Best 

Available 

Copy 


/ 

/ 


CONTENTS 


LIST  0?  ILLUSTRATIONS.  . .  iii 

I  INTRODUCTION . . .  1 

II  AXALY TICAL  RESULTS . .  6 

A.  Covariance  Equations  as  a  Measure  of 

Estimation  Error  .  6 

E.  Variations  of  the  Error  Covariance  Matrix .  9 

C.  The  Sensitivity  Matrix-Variations  Due  to 

Scalar  Parameters .  ...  .  21 

D.  Special  Considerations  in  the  Sampling-Period 
Sensitivity  Matrix — the  Time-Based  Sensitivity 

Matrix .  23 

E.  The  Sensitivity  Index . 25 

?.  Special  Considerations  in  the  Gain-Matrix 

Variation . 27 

G.  Applications  to  Problems  . .  29 

III  APPLICATIONS  TO  SAMPLING  -PERIOD  PROBLEMS .  . .  32 

A.  Design  of  Uniform  Sampling  Period . 32 

B.  Design  of  Nonuniform  Sampling  Period  .  33 

C.  Real-Time  Allocation  of  Computer  Resources 

to  Multiple  Trajectories  .....  .  .  36 

D.  Real-Time  Maneuver  Compensation . .  .  38 

E.  Examples .  39 

IV  ONE -STAGE  TRADE-OFF  STUDIES  USING  A  SIMPLIFIED  MODEL.  .  51 

A.  One-Stage  Trade-Off .  51 

B.  One-Stage  Sampling-Period  Sensitivities .  60 

V  CONCLUSIONS  AND  FUTURE  WORK .  71 

REFERENCES  .  ,  . .  72 

APPENDIX  A— ACTUAL  COVARIANCES  IN  EXTENDED  KALMAN  FILTER  .  .  73 

APPENDIX  B— THE  VARIATIONAL  EQUATION  OF  THE  COVARIANCE 

EQUATIONS . 79 

APPENDIX  C— NORMALIZATION  OF  THE  COVARIANCE  EQUATION  ....  83 

it 


ILLUSTRATIONS 


Fig.  3  .  Multistage  Local  Variations . .  17 

Fig,  2  Time  Shift  in  Sampling -Period  Variation.  ...  23 

Fig.  3  Interpolation  Betweon  Sampling  Points.  ....  24 

Fig' .  4  Uniform  Sampling  Period .  32 

Fig.  5  Nonun if orra  Sampling  Period  .  34 

Fig.  S  Relationship  of  Iteration  Stages  to  Reel  Timo.  .  38 

Fig.  7  Position  Covariances,  1-g  Plant  Noise.  ....  42 

Fig.  3  Sensitivity  of  Terminal  Error  to  Sampling 

Period,  1-g  Plant  Noise .  42 

Fig.  9  Terminal  Position  Sensitivity  to  Covariance 

at  Time  k,  1-g  Plant  Noise  . .  44 

Fig.  10  Position  Covariances,  10-g  Plant  Noise  ....  45 

Fig.  11  Sensitivity  of  Terminal  Error  to  Sampling 

Period,  10-g  Plant  Noise  .  46 

Fig.  12  Terminal  Position  Sensitivity  to  Covariance, 

10-g  Plant  Noise .  47 

Fig.  13  Sensitivity  of  Terminal  Error  to  Sampling 

Period,  Smoothed  Measurements.  ,  .  48 

Fig.  14  Prediction  and  Updating  Stages  in  Kalman 

Filter .  52 

2 

Fig.  15  Effect  of  Sampling  Period  for  1/s  Plant  with 

Position  Measurement  .  .....  64 

Fig.  16  Sampling -Period  Sensitivity  of  One-Stage 

Kalman  Filtering,  a  =  0 . • . .  .  66 

Fig.  17  Sampling-Period  Sensitivity  of  One-Stage 

Kalman  Filtering,  a  =  1 . 67 


ill 


I 


!  INTRODUCTION 

Tho  performance  of  a  Kalman  filter  (rocursivo  filter)  doponds  on  a 
number  of  parameters,  such  us  measurement  accuracy,  a  priori  statistics 
of  the  initial  state,  model  aecurncy,  sampling  period,  and  methods  of 
computing  filter  gains.  Some  of  thoso  are  under  the  jurisdiction  of 
tho  designer  while  others  are  specified,  either  as  fixed  values  or  as 
a  range  of  values.  For  the  designer  to  make  an  appropriate  choice  of 
the  parameters,  he  needs  to  know  the  sensitivity  of  the  filter  perfor¬ 
mance  with  respect  to  the  stated  parameters. 

The  sensitivity  information  will  answer,  as  ex^mpies,  the  following 
questions  frequently  encountered  in  the  design  of  a  Kalm'n  litter, 

(1)  The  noise  statistics  used  in  the  filter  need  toe  be  the 
exact  statistics.  The  question  is:  How  much  perfor¬ 
mance  improvement  may  be  obtained  if  the  statistics 
are  more  accurate? 

(2)  The  iteration  rate  in  computation  (sampling  rate)  need 
not  be  identical  to  the  data  rate.  Tho  questions  are: 

In  the  interest  of  computational  requirements,  how 
slow  can  the  iteration  rate  bo?  How  shall  the  data 
between  the  iterations  be  treated? 

(3)  The  dynamics  equations  in  the  reference  model  of  the 
filter  need  only  be  an  approximation  cf  the  actual 
equations.  The  question  is:  How  much  approximation 
is  tolerable? 

(4)  A  significant  part  of  filter  computation  is  for  the 

i  * 

optimum  filter  gain,  yet  it  has  been  shown  that  sub- 
optimum  gain  requiring  fewer  computations  are  fre¬ 
quently  just  as  good.  The  question  is:  What  is  the 
effect  of  suboptiraal  gains? 

JS 

References  are  listed  at  the  end  of  the  text. 
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(5)  Frequently,  a  certain  typo  of  observations  is  expensive 
to  moke ;  therefore,  it  should  be  used  with  discretion. 

Tit.  question  is;  When  should  wo  use  this  observation? 

(S)  In  implementing  z  real-time  Kalman  filter  on  a  computer 
with  limited  word  length,  computatlon  noises  are  intro¬ 
duced,  The  questions  are:  What  is  the  acceptable  word 
length?  Should  the  filter  gain  be  adjusted  to  account 
for  the  computation  noise? 

The  sensitivity  of  Kalman  filter  may  also  be  applied  to  analyze 
existing  filters  that  are  not  of  the  Kalman  type.  Specifically,  the 
difference  in  the  estimation  errors  for  the  two  filters  may  be  computed 
from  the  sensitivities.  Since  Kalman  filter  is  known  to  be  optimum,  we 
can  then  judge  how  close  tc  optimum  is  the  axisting  filter's  performance. 

Derivations  of  techniques  and  equations  for  the  stated  sensitivity 
questions  are  the  main  concern  of  this  memorandum.  Special  emphasis  is 
placed  on  the  sampling-period  sensitivities.  Examples  are  given  mainly 
tc  illustrate  the  applications  of  these  results.  The  techniques  can  be 
incorporated  readily  into  the  existing  computer  programs. 

The  organization  of  this  memorandum  is  escribed  in  the  following. 

The  error  covariances  computed  by  the  wall-known  covariance-matrix 
equations  are  used  as  the  basis  of  filter  performance.  The  validity  of 
this  approach  is  discussed  in  Sec.  I I -A  and  in  Appendix  A,  In  this  re¬ 
gard,  one  should  make  a  clear  distinction  between  the  "actual"  covariance 
equations,  which  give  the  statistical  descriptions  of  the  actual  errors, 
and  the  computed  covariance  equations,  whose  main  purpose  is  to  obtain 
the  filter  gains. 

In  gain  computations,  one  obtains  certain  matrices,  which  are 
loosely  called  the  covariance  matrices.  These  may  not  represent  the 
actual  covariances  of  the  estimation  error  because  erroneous  noise  and 
dynamics  parameter  values  may  be  used  in  the  computation.  This  may  be 
done  unintentionally  because  knowledge  of  the  process  is  imperfect,  or 
intentionally  to  reduce  the  computation  load.  In  this  memo,  all 


covariances  and  equations  for  their  computations  shall  refer  to  the 
actual  ones,  unless  specific  reference  is  made  to  the  contrary. 

The  exact  changes  in  the  error  covariances  due  to  parameter  varia¬ 
tions  are  given  in  Sec.  II-B.  Of  special  interest  to  the  designer  is 
the  question  of  gain  variation.  The  designer  is  likely  to  have  more  con¬ 
trol  of  the  filter  gain  parameter  than  the  ether  parameters,  such  as  the 
measurement  noise.  For  example,  when  the  parameters  change,  he  may 
either  readjust  the  filter  gains  to  optimal,  or  not  change  the  gain  at 
all.  This  and  other  special  cases  of  filter  gain  can  usually  be  studied 
better  by  using  the  specialized  equations  given  in  Sec.  II-B. 

The  stated  error-covnrionco-variation  problem  may  bo  considorod  aa 
a  special  case  of  the  combined  optimal  control  and  estimation  sensitivity, 
a  continuous-tire  treatment  of  which  is  available.2  On  the  other  hand, 
most  results  available  in  the  literature3"7  may  be  considered  a  special 
case  of  this  memorandum — 'parameters  fixed  and  filter  gains  varied  from 
optimal  to  arbitrary. 

If  estimation  error  at  a  specific  time,  say  the  terminal  time,  is 
of  interest,  the  adjoint  matrix  technique  may  be  used  to  fscil itate  the 
analysis.  The  computational  advantage  will  be  especially  significant 
whenever  an  extensive  analysis  is  to  be  made.  This  is  also  discussed  in 
Sec.  II-B  with  details  in  Appendix  C. 

Sections  II-C,  -D,  and  -E  are  motivated  by  the  sampling -period 
variations.  Two  characteristics  of  the  sampling  period  call  for  the 
special  analysis  of  those  paragraphs.  First,  it  is  a  scalar  parameter 
so  that  the  sensitivity  matrices  or  sensitivity  indices  may  be  defined 
as  in  Secs.  Il-D  and  -E.  This  is  net  possible,  for  example,  for  noise 
covariance-matrix  variations.  Secondly,  for  a  fixed  number  of  stages, 
changing  the  sampling  period  changes  the  overall  duration  of  the  process. 
Therefore,  if  the  overall  time  duration  were  to  remain  fixed,  reducing 
the  sampling  period  would  mean  more  sample  points  are  available  for 
filtering.  In  evaluating  performance  changes,  this  may  nave  to  bo  taken 
into  account. 
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In  Soc .  II-F,  wo  give  tho  socond-ordoi'  offocts  of  filtor  gain  varia¬ 
tion.  This  is  necessary  because,  if  tho  nominal  filter  gain  Is  optimum, 
the  first-order  effects  sre  zero. 

Section  III  specializes  the  previous  results  to  the  sampling -period 
variations.  In  Sec.  III-A,  it  is  suggested  that  the  sensitivity  matrices, 
as  definod  in  Sec.  II-C,  may  be  used  in  a  gradient  procedure  for  the  de¬ 
sign  of  sampling  period.  The  sensitivity  matrix  is  computed  in  tho  for¬ 
ward  direction,  and  therefore  may  be  most  easily  incorporated  into 
existing  programs.  The  restriction  of  this  technique  is  that  the 
sair.pl ing -period  variations  must  be  a  function  of  a  scalar  variable — for 
example,  uniform  sampling  period. 

Nonuniform  (unequal)  sampling  periods  may  be  beneficial  if,  because 
of  computational  limitations,  the  number  of  stages  are  an  important  con¬ 
sideration.  This  is  discussed  in  Sec,  III-B.  Suppose  one  is  interested 
in  the  error  covariance  at  a  certain  time  T.  All  filtering  done  prior  to 
T  contributes  to  the  reduction  in  the  error  covariance  at  T,  but  the 
filtering  done  during  certain  segments  of  this  time  may  contribute  more 
to  this  reduction  than  for  other  time  segments.  The  sensitivity  index, 
derived  from  the  adjoint  matrices,  will  be  a  useful  technique  here.  The 
adjoint  matrix  is  computed  backwards  starting  from  T;  it  relates  the 
covariance  variations  at  T  to  covariance  variations  at  any  stage  prior 
to  T. 

In  Sec.  III-C,  we  point  out  possible  applications  of  the  sensitivity 
techniques  to  real-time  computation  allocation  in  a  multiple-threat 
estimation  situation — cany  separate  estimation  tasks  are  being  performed 
simultaneously  (for  example,  the  multiple-threat  situation  in  the  anti¬ 
missile  missile  system) .  At  any  instant  of  time,  the  effectiveness  of 
the  Kalman  filter  for  different  targets  will  vary.  Using  the  sensitivity 
indices,  we  may  formulate  and  optimize  the  computation  allocation  problem. 

According  to  a  recent  study,®  a  sudden  unpredictable  change  of  plant 
noise  (such  as  a  missile  maneuver)  may  he  detected  from  the  measurements. 
In  the  same  study,  the  noise  increase  is  compensated  by  changing  ^the  fil¬ 
ter  gain  so  that  it  is  optimum  for  the  increased  noise.  However,'  the 
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response  time  of  the  filter  is  soon  to  be  limited  by  the  sampling  period, 
even  with  the  reoptimized  gains.  Further  improvement  is  expected  to 
lie  in  the  reduction  of  the  sampling  period.  The  amount  of  reduction 
may  be  estimated  from  the  trade-off  between  plant  noise  and  sampling 
period  using  the  sensitivity  information  as  discussed  in  Sec.  III-D. 

2 

In  Sec.  III-E,  on  example  is  presented  for  a  1/s  plant  with  posi¬ 
tion  measurements  in  which  the  sensitivity  techniques  that  are  developed 
are  applied  to  the  problem  of  reducing  the  number  of  measurements  to  be 
processed . 

The  trade-off  between  various  parameters,  as  we  have  already  men¬ 
tioned,  may  be  based  on  sensitivity  information.  Section  IV  describes 

2 

this  approach.  Ir.  Sec.  IV,  sensitivity  equations  are  given  for  the  1/s 
plant  mentioned  earlier.  The  results  given  there  can  be  used  to  provide 
insight  into  more  complicated  problems.  Also,  the  one-stage  reduction 
in  position  error  is  plotted  for  various  parameters  ir.  normalized 
quantities. 
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II  ANALYTICAL  RESULTS 


A .  Covariance  Equations  as  a  Measure  of  Estimation  Error 
Let  the  actual  system  be 


x.  ,  =  f ,  ( x. )  +  w. 
k+l  k  k  k 


zk  *  W  +  % 


(1) 


where  f  and  h  are  (in  general)  nonlinear  functions,  x  is  the  state  to 

K  K  K 

be  estimated,  z  is  the  measurement,  w  and  v  are  respectively  the 

K  X  K 

plant  and  measurement  noises  with  zero-mean  Gaussian  distribution;  they 
ere  mutually  uncorrelated  as  well  as  t ime -uncorrelated : 


Etwk3  =  0 


Ejyf 


ECvk]  =  0 


{vU  -  ° 


for  i  /  j 


44'0,ori^ 


S[Viw|  =  0  for  all  i,  j 


f 


The  estimate  of  x^,  given  measurements  z^,  z^,  . ..,  z^,  is  denoted 
by  .  The  extended  Kalman  filter  yields  the  following  recursive 
estimation  equations:  > 

V-l  s  E[X03  =*Q 

Xk/k-l  "  fk-l  (xk-l/k-lJ 
Zk/k-l  *  hk(xk/k-l) 

xk/k  =  Xk/k-l  +  VZk  -  Vk-1}  > 


(2) 


whore  \V  is  the  filter  gain  computed  from  a  set  of  covariance  equations: 


Pk/k-l  =  $k“l  Pk-l/k-l  *k-l  +  Qk-1 

(3) 

V*  *  «  -  W  Vk-1  (I  -  \vT  *  wl  > 

where 

$k-l  =  (fk-l)  =  5fk-l/ax 

X 

Hk  -  K)x  -  3hk/8x>  ! 

and  the  initial  value  for  the  covariance  is 

P0/“l  ~  E  [|X0  ”  X0^  {x0  ”  X0>  J  * 

In  Eq.  (3),  the  filter  gain  W  is  arbitrary.  It  is  common  practice 

* 

to  use  the  following  approximately  optimum  gain: 

\  -  Vk-i  ■£  (HkVk-iHk +  "k ) 1  •  <4> 


In  this  memorandum,  the  error  covariance  is  taken  to  be  a  measure 
of  the  performance  of  the  extended  Kalman  filter.  The  estimation  error, 
denoted  by  x^^  ox*  Xjj/k-1*  is  ^0^'-nec^  as 


xk/k  =  xk  xk/k 
xk/k-l  =  xk  xk/k-l 


(5> 


Since* they  are  random  variables,  descriptions  of  x 

iw 

a  description  of  their  probability  distributions. 


k/k 


and  x 


k/k“l 


require 


*The  gaiu  in  Eq.  '4)  yields  a  minimum  variance  estimator,  or  maximum 
likelihood  estimator  for  the  linearized  system  of  Eq .  (1)  under  the 
stated  assumptions  on  the  noises  v  and  w. 
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is 


When  f,  and  h,  aro  linear  functions,  it  can  bo  shown  that  x  , 

*  k  k/k 

a  Gaussian  variable.  Its  expectation  and  covariance  are,  therefore, 
sufficient  “to  describe  its  probability  distribution.  In  fact, 


Vk  •  EKk/k)  -  0 

(6) 

E  j^*k/k  "  ’‘k/k5  ^xk/k  "  *k/kJ _  =  Pk/k 

? 

(7) 

where  is  given  in  Eq,  (3). 

When  f  and  h,  are  nonlinear  functions,  os  generally  is  the  case  in 

K  iC 

practical  systems,  is  no  longer  Gaussian.  In  such  cases,  it  may  be 

difficult  to  obtain  a  complete  description  of  its  probability  distribu¬ 
tions.  However,  the  first  two  moments  E[x  ,  ]  and 

r  ~  ^  fpi  k/k 

E  '<Xk/k  “  \/'J  (xk/k  “  \/\?  I  SiVe  3  fairly  good  ide&  of  the  Proba¬ 
bility  distribution.  As  shown" in  Appendix  A,  they  are  easily  approxi¬ 
mated  by 


where  we  have  used  the  following  notation:  f.  •  ?  is  a  vector,  the  i-th 
component  of  which  is  given  by 
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We  note  that  the  approximate  covariance  equations  in  the  nonlinear 
case  of  Eq.  (9)  are  identical  to  Eq.  (3),  but  the  errors  are  no  longer 
zero  mean,  as  can  be  seen  from  Eq.  (8) . 

The  expected  values  in  Eq .  (8)  may  be  made  zero  by  modifying  the 
extended  Kalman  filter  equation  of  Eq.  (1)  to  those  corresponding  to 
Eq  t  (A. 11)  in  Appendix  A.  Normally,  Eq .  (8)  is  not  available  in  an  ex¬ 
tended  Kalman  filter  program  while  the  covariances  of  Eq .  (9)  are  avail¬ 
able.  For  these  reasons,  the  variations  in  covariances  due  to  parameter 
variations  will  be  analyzed  in  this  memorandum,  using  Eq.  (9). 


B.  Variations  of  the  Error  Covariance  Matrix 


We  assume  the  existence  of  a  nominal  Kalman  filter.  This  means 
that  we  use  a  nominal  (not  necessarily  optimum)  in  the  manner  shown 
in  Eq.  (2)  for  a  physical  process  with  parameters  PQ^  Q^,  R^. 

The  resultant,  filter-error  covariance  is  •  Let  the  physical 
parameters  as  well  as  the  filter  gain  be  changed  so  that 
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1Ct  Tk  b°  th°  trrnslcrr‘ation  Mich  that  the  outputs  (minus  noisos)  are 

components  of  a  new  state  x*: 

k 


x*  A  T  x  - 
k  =  k  k  ~ 


W 


We  may  write  Eq.  (1)  in  the  following  form: 


Tk+lxk+l  =  Tk+lfk  »T- 


-1 


■> 

h,  (x,  ) 

k  k 

yk 

L.  J 

j 

I  +  Tk+lwh 


1 

=  [I  0] 


w 


+  v. 


(13) 


(14) 


or 


*Li  - 


:k  \ 


(15) 


In  this  new  form,  is  constant, 
be  viewed  as  a  A$. 


This  verifies  our  assertion  that 


Forward  Recursive  Equations 

^k/k  ®ay  ^  obtained  by  a  straightforward  substitution  of  Eq . 
(10)  into  the  recursive  covariance  equations,  as  shown  in  Appendix  B. 
The  results  may  best  be  organized  according  to  the  optimality  of  the 
filter  gains  before  and  after  parameters  variations.  Let  us  use  the 
following  notation: 

Wk+1  =  0ptinal  ror  Pk/k'  V  V  and  Rk*l 

o 

AWk+1  ~  Change  in  gain  so  that  the  new  gain  is  optimal  for 


k/k 


+  AP. 


k/k’ 


K  +  Qj,  +  AQ. 


and  R.  , 
*t+l 


**k 


+1 


(16) 
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Tho  deviation  of  the  error  oovarianoe  from  its  nominal  ls  eiVeo  by  the 
expression 


=  (I  ~  W  ^k/k-i  (I  "  W 1  4  \ARkWk  +  Ak  +  \  > 

\  ■  Fk(HkPk/k-lHk  *  \)  -  W<]  < 

*  S\[\(VkA-lBk  *  \)  '  pk/k-lHjj 


where 


AWk  =  0  or  ^  we  have  Ak  =  0  ; 

■  [\KvX  *  «J  -  *wiK 

+  *»£*(vw£  -  n)  -  «w£|T 

*  4Wk["k<pk/k-i  *  “Wi,Hk  *  !8k *  “k’Vk  • 


Nominal  quantitiea  are  need  for  P^,  ^  ^  a„d  »  If  *  .  *» 

we  have  the  following  negative  definite  expression  for  (A  a  B  )°:  * 

^  k 


(\  * 


Bh>°  -  -  ([\(-k“k/k-i«kT  -  «j  -  *wfj 

*  j>(Vk/k-i<  ♦  »k)  -  Vk-i»fj] 

•  [yw  -  ^k/k-x  -  «k ♦  *yj 

•  {[*.,(vw<  *  *\)  -  *wf 

*  [w*(Vk/k-i»k  *  \)  -  Vk-i«kj) 


.  (21) 
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1/  iV  =  W®  the  resultant  (A,  +  B,  )°  will  bo  denoted  by  B°  If 

K  A  K 

AW  =  0,  v>e  have  B,  =  0  .  (22) 

k  ’  k 

If  AW^  r  0,  but  APj./k-l'  AH^  are  zero,  the  expression  for  becomes 
positive  definite: 


-  »s['kW<  *  Bk]  «l 


This  equation  and  Eq.  (8)  in  fact  show  that 


\  *  Vk-iHkKv«-i"k  *  \) 


is  a  minimum  variance  filter  gain  for  P^^  ^  and  R^:  if  gain  is  changed 
from  the  given  expression,  the  error  covariance  would  be  changed  by  an 


amount 


AP,  =  A,  +  B,  a  0  +  AW,  H  P,  ,H*  +  K,  AW*  ,  (25) 

k/k  k  k  kTk  k/k-1  k  kj  k  * 

which  is  positive  definite,  indicating  an  increase  in  the  error  co- 
variance.  To  complete  the  recursive  equations,  ^P^+i/k  is 

^k+l/k  =  5k  ^k/k  \  + 

+  A?k(Pk/k  +  APk/k)  $k  +  $k(Pk/k  +  A?k/k)  f 

t 

♦  4V\a-  *  “W  kil  •  <26>. 


If  A5,  =  0,  we  have 
k 


^k+l/k  =  ^k^k/k^k  +  *%. 


Of  particular  interest  is  a  comparison  between  the  cases  with 

AW,  *  0  and  AW,  =  AW°  when  W  =  W°.  AW,  is  zero  when  the  filter  is  not 
k  k  x'  k 
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readjusted  after  parameter  variations;  we  then  have,  by  Eqs .  <17),  (13), 


and  (22), 


-  <>  -  W  “Wi'1  -  W*  *  w£ 


■  t 


If  the  gain  is  readjusted  to  optimal,  i.o.,  Aw.  =  Aw.  ,  we  have 

K  K 

*  <■  -  Vic’  °  -  Vk)T  *  wl +  Bk  -  (2S> 

where  B°  is  a  negative  definite  matrix  [see  Eq ,  (21)3: 
k 

-  [-(i  -  Vk  )4wS  *  vb3  [vw  *  “Vk-X +  lRk  *  *v] 


Because 


n/k  -  -  -  Bk 


B°,  therefore,  represents  the  deci’ease  in  the  error  covariance  by  optimal 
k 

readjustment  of  the  gains  according  to  the  variations  in  §k,  Pfc,  Qk,  and 

R  ,  over  the  case  when  the  variations  are  ignored t  B°  is  of  second- 
k+1  K 

and  third-order  of  the  variations  [see  Eq .  (21)].  When  the  first- 

order  term  dominates  in  problems  such  as  the  sampling -period  sensitivity 

the  term  may  safely  be  ignored.  On  the  other  hand,  this  term  is  of 

utmost  importance  in  analyzing  suboptimal  gains,  because  the  first-order 

term  is  zero.  From  the  value  of  information  viewpoint,  B°  justifies  the 

accuracies  the  designer  has  available  or  is  requesting  on  §k,  P^, 

and  R  .  It  tells  how  much  improvement  in  estimation  error  he  would 
k+1 

obtain  if  the  accuracies  were  improved. 

Tha  variational  equations  up  to  this  point  have  been  exact  and 
general.  In  what  follows,  we  may  sometimes  use  specialized  and/or 
approximate  versions  of  the  variational  equations  for  specific  problems. 
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These  problems  are  organized  and  discussed  in  Secs.  II-G  and  HI,  ■  but' 
first  ve  shall  introduce  the  concept  of  the  adjoint  matrix  for  tne 
Kalman  filter. 

Tno  Error  Transition  Matrix  and  the  Adjoint  Matrix 


Often  one  wishes  to  know  how  P,jyT  at  a  specific  sample  point  T 
changes  because  of  changes  in  Q,  R,  9,  or  W  at  some  previous  and 
possibly  wid-sly  separated  sample  points.  Using  the  error  transition 
matrices  and  adjoint  matrices  discussed  later  in  this  section,  it  is 
possible  to  study  these  changes  without  having  to  solve  repeatedly  the 
full  recursive  Eqs.  (17)  and  (26).  However,  for  these  techniques  to  be 
feasible,  we  have  to  use  the  first-order  approximation  (second-order 
approximation  in  suboptimal  gain  case)  of  the  full  recursive  Eqs.  (17) 
and  (26) . 


Let  us  study  the  variations  from  k  -  1  to  kth  sample  points.  The 
relevant  variations  are  A$k_^,  AQ^^,  AR^,  and  AW^ .  We  also  have 
AP  ,  which  is  caused  by  the  previous  parameter  variations.  We 

to  be  first  order  in  magnitude 


shall  take  AP, 


This  is  not  always 


k-l/k-l 

so,  as  we  shall  see  later  on  in  suboptimal  gain  analysis  that  AP^^y^-i 
is  second  order  in  AW.  Let  us  also  define  matrices  AZ^^^  and  AZ^^ 
by  the  following  equations,  which  may  be  regarded  as  the  first-order 
approximation  of  the  local  (one-stage)  covariance  variations— by 
setting  =  0  in  Eqs.  (13)  and  (7)  and  keeping  the  first-order 

terms: 


T  T 

AZk/k-.l  =  AQk-l  +  A*k-lPk-i/k-l§k-l  +  \-lPk-l/k-lA\-l 

“kA  - (I  -  W  *V«-1  (I  -  Vk,T  *  wJ  *  Ak  (31> 


AZ0/-1  -  **0/-!  » 


where  A  is  given  in  Eq .  (IS),  a  first-order  expression  in  AW.  B  does 

not  appear  because  it  is  higher  than  first  order.  The  only  parameter 

variations  that  appear  in  the  above  equations  are  local— -A$k_1#  AQ^,  AR^j 

and  AW,  .  Furthermore,  AZ.  ..  s  0  if  these  local  parameters  arc  unchanged. 

R  k/K 


IS 


The  covariance  variations  [Eqs.  (17)  and  (26)]  are  now: 


“V*  -  "  -  WVAWL  (I  -  \VT  +  *Vk  •  <32) 

Applying  the  last  equation  recursively  from  k  =  0  to  k  =  T/we  have 
“*T/T  -  £DT,4  -  <33) 

J 

where  j  =  those  integers  such  that  at  least  one  of  the  variations  A$. 

J  * 

AQ.  ,,  AR and  AW.  exist.  D„  .  is  given  by  Eq.  (34): 

J-l'  j'  J 

DT,J  6  "  -ItV'w  (I  -*T-lW*T-2  •••  a  -  VW‘i  •  <M) 

t 

The  D  .  will  be  cabled  the  error  transition  matrices.  They  give  a  direct 
connection  between  the  local  covariance  variations  AZ^^  and  AP^^, .  They 
are  computed  backwards,  using  nominal  quantities  in  time  from  T  to  j  by 
the  following  recursive  equation: 


°r,j  ’  \j,i  11  ' 


D_  =  I,  the  unit  matrix 


In  particular  problems,  it  may  be  more  convenient  to  use  multistage 
local  variations.  The  filtering  process  is  divided  (see  Fig.  1)  into  m 
time  segments;  let  the  dividing  points  be  the  set  of  sample  points 
(Jp  J2,  J3,  Jm>.  We  have 

\  ^  ^  rn 


V  A_VJi**r  r  T 

“  DT,jjL  AZJi/ji  DT,ji  » 


where  AZj./j,  denotes  a  multistage  local  variation  for  the  to  jjth 

segment,  obtained  by  solving  the  following  recursive  equations  [Eq. 


(37))  (^  -  Ji_1)  times: 
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AZ 


^i-1^  ^i-1^  T  T 

k/k-1  =  $k-l  AZk-l/k-l  *k-l  +  AQk-l  +  A*k-lPk-l/k-l\-l 


Az 


+  \-lPk-l/k-l  (A\-1) 


(W 

k/k 


(37) 


U  -  Vk>  “kA-l  U  '  Vk)T  +  W£  -  Ak  < 


where  is  defined  in  Eq.  (18) ,  and 


with 


k  =  ji-l  +  X> 


Ji-1 


+  2, 


*1 


<w 

ji-l/ji-l 


=  0 


AZ 


Oh) 

ii/ii 


FIG.  1  MULTISTAGE  LOCAL  VARIATIONS 

(■  v 

The  discussed  error  transition  matrices  are  valuable  in  filter 
synthesis.  For  example,  in  order  to  investigate  the  effect  of  m  dif¬ 
ference  ARq  on  AP.jy.p,  according  to  Eqs.  (33)  and  (31),  one  only  has  to 
investigate  the  expression  t  m  times — a  great  time  saving 

from  having  to  solve  the  recursive  equations  [Eqs.  (17)  and  (26)]  m 
times  from  k  =  0  to  T. 
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Often  one  is  interested  in  knowing  the  following  scalar  function, 
J,  of  AP,ryT  rather  than  the  whole  AP,^  matrix  itself: 


J  =  tr 


(38) 


A  J  =  tr  <lt/tapt/t>  >  <38) 

where  tr  denotes  the  matrix  trace  operation. 

As  an  example,  the  so-called  root-sum-squared  (rss)  position  error 
may  be  written  in  the  above  form  for  J.  Thus,  the  state  of  a  trajectory 
in  three-dimensional  motion  may  be 


where  x^,  x2,  x3  are  position  and  x^,  x^,  x^  are  velocity  coordinates. 
The  error  in  x  is  bx: 


6x 


6x. 


6x_ 


6x„ 


6x, 


6xe 


6x, 


P T^T  is  the  covariance  matrix  of  6x, 


t 

) 
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.=  2  [  ( fix  -  fix)  (fix  -  6x)T] 

The  rss  position  error  is,  by  the  d -fin  it  ions  of  rss  and  the  trace 
operator, 

(rss)  ,  tr<LT/TPT/T> 

with 


The  variation  in  rss  position  error  is  now  expressible  by 


(40J 


Aj  =  A(rss)  =  tr(LT/TM>T/T) 

LT/T  is  the  adJQj-n^  matrix  at  T.  Its  exact  form  depends  on  the  problem 

at  hand.  As  ano'-her  example,  if  we  are  only  interested  in  the  covariance 

of  fix, ,  L_  /m  should  then  be 
1*  T/T 


The  equation  for  computing  AJ  is  obtained  by  combining  Eqs.  (39) 
and  (33) : 
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=  /C  tr(LT/TDT,  j) 

0 

-  2  tr(DT./jLT/TDT,  j^j/j) 
3 

1J  =  E  «>•<  vA/? 

Lj/J  -  dt, jlt/tdt, 0 


(41) 


(42) 


The  L  ,  are  called  the  adjoint  matrices;  L...  may  be  computed  [see  Eq. 

j/j  J/J 

(35)]  by  the  following  backwards  recursive  equation: 


r  _  $T  (i 

K-l/k-1  "  k-lVi 


Wr  Lk/ka  -  W5k-1 


(43) 


where  L^T  is  to  be  appropriately  defined  for  the  particular  problem. 

To  summarize  the  above  technique  known  as  the  adjoint-matrix  tech- 

! 

nique,  we  first  use  Eqs .  (42)  and  (43)  to  compute  the  adjoint  matrices 


k/k 
and  $ 


,  k  =  T,  T  -  1,  T  -  2,  using  the  nominal  quantities  W  ,  H  , 


k-1  * 


J  may  now  be  written  easily  using  L^y^  and  local  variations 


of  Eq.  (31),  thus 


tr(  ww  - M  -  Z  '’•‘vA/j’ 

5 


where  j  are  those  samples  points  with  nonzero  &  y  y 

L  and  D„  .  enable  one  to  relate  directly  local  covariance  varia- 
j/j  T,j 

tions  t&j/y  with  terminal -error  variation.  This  provides  a  systematic 
and  straightforward  technique  for  such  sensitivity  and  trade-off  analysis 
as 
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(1)  The  necessary  duration  of  the  filtering  process 

(2)  Seeking  least  sensitive  spots  on  the  filtering  time 
axis  for  sampling  rate  reduction 

(3)  Redistributing  the  sampling  points  for  improved 
terminal  accuracy 

(4)  Optimizing  the  usage  of  an  expensive  observation— 
the  seeking  of  sample  points  when  the  observation 
causes  the  largest  terminal  error  reduction 

(5)  Optimum  radar  resource  allocation 

(6)  Trade-offs  between  various  error  sources— measure¬ 
ment,  modeling,  and  sampling  rate. 

These  topics  will  be  discussed  in  more  detail  in  later  sections, 
and  in  examples  of  Sec.  III. 

C  .  The  Sensitiv ity  Matrix — Variations  Due  to  Scalar  Parameters 


Up  to  now,  we  have  considered  the  independent  variations  to  be  in 
the  general  matrix  form— A$k-1,  AQk_^,  A V?k,  AR^,.  Here  we  introduce 
another  level  of  parametrization;  we  let  A$k-1,  AQk_p  and  AR^  be 

functions  of  a  scalar  variable  denoted  by  a.  For  example,  the  sampling 
period  (time  between  two  consecutive  sample  points)  in  a  filter  with 
uniform  sampling  rate  is  such  a  parameter.  ® 


Let  each  element  in  the  matrices  A$k-1,  ^k~l’ 


and  Aft,  be 
k 


functions  of  a  scalar  variable  a.  Each  element  of  is,  therefore,  v 


I, 


a  function  of  a.  This  leads  to  the  following  definition  of  a  sensi¬ 
tivity  matrix: 


dP 


k/k 


dor 


dor 


=  lira  —  [P(a  +  Ao?)  -  P(QQ]  =  lim  ~  AP,  ,,  (a) 
Aa-0  60f  •  Aa-0  k/k 


(44) 


(dp,  ,./ha)  propagates  in  time  according  to  a  set  of  recursive  equations, 

K/k 

which  will  be  shown  later.  Once  (dPk/k/da)  is  obtained,  APk/>k  may  be 
easily  computed  to  first  order  as 
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(■15) 


“k/k""  *  (aPk/K/a“>  ^ 


Tlio  recursive  equations  for  the  sensitivity  matrix  may  be  derived 
by  taking  limits  [as  indicated  in  Eq .  (44)]  of  Eqs ,  (17)  and  (26): 


3P 


k/k 


da 


dP.  „  ,  m  &R,  ,, 

r  v  nt  tt  \  k/k-1  ,  ^  .  T  tl,  k  *  ,T  .  / 

“  °  •  w  —— 11  -  W  *  \  55-  \  +  Ak 


(46) 


and 


apk+l/k  _  .  5Pk/k  ,T  aQk  5*k  ,  ,T 

3a  k  9a  k  +  da  +  da  Pk/k  k  +  kPk/k 


(47) 


(48) 


where  all  second-  and  third-order  terms  vanish  because  of  the  limiting 
process.  These  equations  are  seen  to  be  similar  to  the  covariance 
equations,  Eq .  (3).  This  indicates  that  in  9  simulation  of  the  Kalman 
filter,  the  sensitivity-matrix  computation  may  be  added  with  a  minimum 
amount  of  effort. 


The  scalar  parameters  we  shall  be  concerned  with  are: 

,(1)  Sampling  period  t;  in  general,  Q^,  and  are 

functions  of  T.  $,  ,  the  transition  matrix  for  the 
k* 

system  dynamics,  is  a  time  integral  depending  cn  T, 
generally  increases  with  t  because  a  longer 
sampling  period  allows  the  dynamics' error  to  build 
up  between  sampling  points.  The  measurement  error 
R  changes  with  t  in  a  manner  depending  on  the  data 

K 

prosmoothing  used  with  the  filter.  If  no  prosmoothing 
is  used,  then  R  does  not  change  with  t.  To  summarize: 

JV 


22 


b§  /bt  0,  bQ,  /br  'f  0}  and  bR  /br  may  or  may  not 
K  K  K> 

equal  zero. 

(2)  Dynamic  error  parameter,  d:  The  dynamics  error  is 
common iy  modeled  as  plant  noise.  is,  therefore, 
a  function  of  d,  while  $  and  R  are  not; 

bf^/bd  i  0,  bR^/3d  =  c,  a$k/bd  =  0 

(3)  Measurement  noise  parameter,  r:  bR^/br  ^  0,  but 

b§  /br  =  0,  and  bQ  /br  =  0. 

K  K 

To  compute  the  sensitivity  matrices  of  these  parameters,  we  use 
Eqs.  (46)  and  (47)  with  O'  =  T,  d,  or  r. 

D.  Special  Considerations  in  the  Sampling-Period  Sensitivity  Matrix — 
the  Time-Based  Sensitivity  Matrix 

The  sensitivity  bPk/k/bT  discussed  previously  is  evaluated  with  k 
fixed.  The  derivative  is  therefore  evaluated  along  the  slanted  dotted 
line  in  the  P  vs.  t  diagram  of  Fig.  2.  But  we  are  often  interested 


FIG.  2  TIME  SHIFT  IN  SAMPLING- 
PERIOD  VARIATION 

in  a  sensitivity  that  is  time-fixed;  for  example,  consider  the  case  in 
which  the  time  duration  of  the  filtering  process  is  to  remain  unchanged. 
Then,  in  Fig.  2,  we  should  consider  a  derivative  evaluated  along. the 
vertical  direction  by  letting  P^.^t)  +  AP^^  “PProach  ^k/k^  *  *n 
section,  we  shall  devise  techniques  to  evaluate  the  time-fixed  sensitivity. 
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In  Fig.  3  wo  depict  the  of feet  of  o  small  change  6t  in  tho 
sampling  period  7  for  k  iterations.  #  denoting  tho  error  co- 

variance  at  k-th  sample  point  with  sampling  period  T,  is  changed  to 
Pk/k(T  ♦  IT)  4  Pk/k(T)  +  a>k/k,  and  Pk.1/k,1(T)  to  Pk.1/k.1(T  .  M  . 


pk-l/k-l  (T  +  = 


FIG.  3  INTERPOLATION  BETWEEN  SAMPLE  POINTS 

While,  strictly  speaking,  the  error  covariances  are  not  defined  between 
the  sample  points  k  -  1  and  k,  we  shall  interpolate  using  +  At) 

and  pj{/k(T  +  At)  to  assign  a  covariance  matrix  at  the  point  marked  A. 

This  matrix  is  designated  by  +  At)  =  pkA<T>  *  Kw  and  w 


k/k 


is  taken  to  be  the  fixed-time  variation  under  the  influence  of  At. 
Carrying  out  the  interpolation,  we  have 


Vk'T>  +  “kA 


tPk/k(T)  +  ^k/k3 

[Pk-l/k-l(T)  +  ^k-l/k-l  "  Pk/k(T) 


“  ^k/k3 


(t  +  At)  . 


k(AT) 


Therefore, 


AP 


k/k 


At 


APk/k  .  Pk-l/k-l(T)  _  Pk/k(7)  ^k-l/k-l  *  ^k/k 

•r  k  - — - r~t — -  +  k - 


At 


(t  +  At) 


(t  +  At) 


{<19) 


/ 
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Letting  At  -*  0,  and  remembering  that  AP^  ^  -•  0,  AP^y^  "■  0  as  At  -•  0, 
so  that  the  last  term  is  zero  as  At  -*  0,  we  have: 


SpkA 

Bt 


4  lim 
At'O 


AP 


k/k 


BP, 


At 


sr*?  •  <50> 


The  time-fixed  sampling -period  sensitivity  matrix  oP;  .  /Bt  is 


k/k 

therefore  obtainable  from  the  sampling-point-fixed  sensitivity  matrix 
Bp^/r/Bt  by  taking  into  account  the  slope  of  P^yk(T),  as  shown  in  Eq. 
(50)  . 


E .  The  Sensitivity  Index 


If  we  limit  our  discussion  to  scalar  parameter  variations  Ac*  and 
scalar  filter  performance  criteria  J,  wo  are  then  interested  In  sensi¬ 
tivity  indices  of  the  type 


I 


s  4^ 

a  -  da 


(51) 


where  «  =  various  scalar  parameters,  for  example,  those  listed  in  the 
last  part  of  Sec.  II-C. 

rhese  sensitivity  indices  may  be  precomputed  using  the  previous 

results  on  sensitivity  and  adjoint  matrices;  the  S,  being  scalars,  are 

stored  more  easily  than  the  adjoint  or  sensitivity  matrices.  S  are 

therefore  seen  to  be  a  useful  technique  for  real-time  modifications  of 

the  filter.  For  example,  in  the  antimissile  defense  system,  we  may  let 

J  be  the  covariance  of  the  error  in  the  position  estimate  at  a  certain 

range  from  the  radar  sites,  where  interceptor  commitments  have  to  be 

made.  Let  a  be  the  iteration  rate  C,  Now,  assume  a  multiple-threat 

situation  arises  such  that  the  design  iteration  rate  C  cannot  be  met 

o 

for  all  incoming  vehicles  because  of  computation  limitations.  This 
calls  for  a  real-time  decision  on  how  the  iteration  rate  should  be  re¬ 
duced,  and  an  estimate  of  the  consequences.  These  tasks  are  made  easier 
if  the  sensitivity  indices  (j  =  1,  2,  ....  m  for  m  different  reentry 

vehicles)  are  available  in  real  time,  for  then  the  increase  in  terminal 

position  error  for  each  vehicle  is  expressible  as  AJ^  =  (AC.). 

C  J 


From  criterion  on  AJ^ ,  because  the  terminal  accuracies  aro  tho  main 

concern  in  this  example,  we  may  compute  AC.  from  the  stated  equations. 

3 

To  compute  the  sensitivity  indices,  we  use  tho  sensitivity  matrices 
and  ad joint -matrix  technique  discussed  previously.  This  gives 


_  oj  a  .  ,T  _  .  .  L  t/t 

Sa  =  Sa  ~  Sa  tr(LT/TPT/T*  =  tr(LT/T  S a 


_  y  J,  azj/j 

j  *  \  ^  aof 


where  (SZ^^^/Sgc)  are  the  local  one-stage  sensitivity  matrices  obtained 
by  the  following  limit: 


=  lim 
Acr-O 


Therefore,  upon  using  Eq.  (31),  we  have 
3Zk/k-l  9Qk-l  ^^k-l  r  A 


aQk>l  +  ^Vl  j  §T 

~  ha  da  *k-l/k~l  k-1  k-1  k-l/k-1  \  da  j 


^Zk/k  ^Zk/k-l  T  ^Rk  T  t 

~£t  •  (I  -  W  “S5—  (I  -  W  +  \  S3T \  +  Ak 


-  [\(HkPk/kHk  +  Rk)  -  pkA-i<]  (S1) 


[tf  (h  P .  H?  +  R  )  -  P  /  ,hJ 
00/  [_k\  k  k/k-1  k  k  /  k/k-1  k 


Note  that  the  same  equations  may  be  obtained  from  the  sensitivity  equa- 
tions  [Eqs.  (46)  and  (47)3  upon  setting 


(SVlA-l/Sc,)  *  0 


If  we  are  computing  the  sampling-period  sensitivities  for  time- 

fixed  variations,  the  slope  correction  shown  in  Eq .  (50)  must  be  used. 
Also,  instead  of  using  a  one-stage  local  variation,  AZ^,  mQy  be 
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more  convenient  in  particular  problems  to  use  a  multistage  local  varia¬ 
tion,  of  Eqs.  (36)  and  (37). 


F.  Special  Considerations  in  the  Gain-Matrix  Variation 

o 

If  the  nominal  filter  gain  is  optimum  W^,  the  sensitivity-matrix 
techniques  such  as  those  in  Secs.  II-C,  -D,  and  -E,  do  not  give  usable 
answers,  because  in  those  techniques  only  first-order  variations  are 
considered,  while  the  variation  in  performance  about  the  optimum  W°  is 
second  order  in  AW  .  Here  the  analysis  calls  for  a  return  to  the  exact 

K 

equations  of  Sec.  II-B  for  second-order  variations.  We  shall  consider 
only  the  special  case  that  W  varies  from  W°  to  W°  +  AW  ;  all  other 

K  K  K  iv 

parameters  Q^,  pq/1^  are  to  remain  Then,  in  the  varia¬ 

tional  equations  [Eqs.  (17)  and  (36)]  all  first-order  terms  disappear..^ 
We  have  • 


AP 


0/-1 


=  0 


V 


AP. 


k/k-1 

n/k 


$  Ap 

\-rk-i/k-i  k-i 
/ 


ii  -  WX)  “Wit1  -  WX) 

+  AW,  H,  p,  .hJ  +  R.  Awf  +  (higher-order  terms) 
k_k  k/k-1  k  kj  k 


(55) 


We  have  used  the  following  observation  in  the  last  equation: 

AP.  and  AP.  1  ,.  stays  second  order  for  k  =  0,  1,  2,  ...  as  may  be  seen 
by  tracing  tho  recursive  equation  for  k  =  0,  1,  2,  ...  .  Therefore, 
although  the  APk/k_xH^&w^  term  in  Eci  •  appears  to  be  of  second 

order,  it  is  really  of  third  order. 

Equation  (55)  is  now  approximated  by  neglecting  the  higher-order 
terms,  obtaining  *  ; 


AP. 


k/k 


-  (’  -  <\) 


$k-l(APk-l/k-l) 


Cit1  -”X) 


+ 


H,  P.  ,,  .  H, 
k  k/k-1  k 


(56) 
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It  is  noted  that,  due  to  the  separation  of  AP,  ,  ,,  ,  and  AW  terms, 

k-l/k-1  k  ’ 

we  may  employ  the  concepts  of  the  local  covariance  matrices,  the  error 
transition  matrices,  and  the  adjoint  matrices — concepts  that  were  de¬ 
veloped  originally  for  the  first-order  variation.  The  applicable  equa¬ 
tions  are  given  below: 

The  local  covariance  variation  is 

Mk/k  -  "k(Vk/k-X  =  0,  1,  2,  ...  (57) 


so  that 

“U  - 11  -  w  w“Wk-i>  i-in  -  wT  +  «kA  •  • (58> 

Terminal  covariance  variation  is  expressible  as  sum  of  local  variations: 


AP, 


■  E 


T/T  "  4-'  DT,kAZk,kDT,k  ’ 
k  ’  ’  * 


(59) 


where  D  is  tha  error  transition  matrix  by  the  recursive  equation 

r,  k 


D_  .  =  D_  .  ,(I  -  W,  H.  ,)  $, 
T,k  T,  k+1  k+1  k+1  k 


(60) 


with 


°T,T  ~  1 


Terminal  AJ  is  expressible  as  sum  of  local  variations: 


“  *  "VtV  -  E  *  <61> 


where  is  the  adjoint  matrix  defined  by  the  recursive  equation 


L,  *  i7(I  -  W,  H,  ,)T  L,  ,  ..  _(I-W,  ,H,  .)  i, 
k/k  k  k+1  k+1  k+l/k+1  k+1  k+1  k 


(62) 


with  defined  arbitrarily  depending  on  the  problem. 
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Suppose  wo  wisn  to  investigate  the  effect  of  AW  at  a  certain  sample 
point  of  P,jyT>  then  wo  need  only  evaluate  the  matrix 


DT,A(VkA-AT  +  \)  “X, 


k  "  DT,kiZk/kDT,k 


or  the  following  scalar  if  J  =  tr^L-j>/TPT/T^  is  of  interest; 

tr[KLkA®k)  (vw-i'I  +  Rk)]  "‘'"viV  •  (64) 

These  two  terms  provide  a  valuable  aid  for  the  design  of  suboptimal 
Kalman  filter  gains.  Suooptimal  gains  are  of  practical  interest  because 
often  they  may  be  computed  simply  and  their  use  causes  very  little  in¬ 
crease  in  the  estimation  error.  As  an  example,  suppose  we  specify  an 
allowable  AJ.  AJ  can  be  allocated  among  the  sample  points  by  some 
acceptable  rules  depending  on  the  problem: 


Setting 


CSJ>k  = 

-  tr[KLkA®k)  kw$  *  *0]  - 

we  obtain  an  elliptical  region  around  W^,  within  which  any  AW^  will  cause 
a  AJ  within  the  allocated  (AJ).  .  In  this  way,  a  manifold  may  be  defined 

K 

around  the  W?  vs.  k  curve  such  that  it  contains  all  the  allowable  sub- 
k 

optimal  gain  curves.  Many  other  ways  of  applying  these  equations  are 
possible.  ’ 

G.  Applications  to  Problems 

Depending  on  the  particular  problem,  different  parameters  are  varied 
and  different  performance  criteria  are  used.  The  following  are  a  few 
examples: 
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<1) 


(2) 


k/k 


(3) 


Inaccurate  statistics:  Since  the  statistics  P 


0/-V 


Q,  ,,  and  R.  arc  used  to  obtain  tho  filter  gain  W,  , 
k-1  k  &  k* 

the  real  question  is  the  effect  of  using  tho  wrong 
gain.  Put,  for  computation,  we  may  use  the  following 
equivalent  problem.  Let  P*^,  Q*_1,  R*  bo  tho 


orronoous  statistics  that  givo  W*  and  P*^. 


piU  18 


not  tho  real  covariance;  howovor,  tho  real  covariance 

Pk/k  =  Pk/k  +  APk/k>  whorG  ^k/k  may  bc  comPutod 
using  tho  variational  equations  [Eqs.  (17)  and 

(25)]  with  AW,.  =0,  AP„,  ,  =  P„,  ,  -  P* 


Vk  =  °»  AP0/~1  =  ‘0/-1  Jr0/-1> 


may 


Wk-S  -  Vl  -  %*-!' “k  -\-K-  Vk 

therefore  be  computed  from  P* ,  ,  which  is  available 

K/  K 

in  the  gain  computations. 


The  value  of  exact  statistics:  Suppose  we  know  the 
exact  statistics,  the  estimation-error  covariance 
may  be  improved  from  the  P^^  described  in  (1), 
because  we  are  now  able  to  compute  the  exact  optimum 
gain.  Let  the  resultant  covariance  be 

Pk/k  *  pJ/k  *  “w  whsre  “k/k  ari5es  '3U,  o1  the 
A?0/_1,  AQk_1,  and  AR^  of  (1),  tut  with  =  AW° 

instead  of  zero.  The  value  of  the  exact  statistics 

is  therefore 


-  P. 


k/k 


_  p* 

~  k/k 


+  AP. 


k/k 


-  p* 

k/k 


-  AP. 


k/k 


-  AP, 


k/k 


-  AP. 


k/k 


This  turns  out  to  be  the  negative  definite  term  B° 
shown  in  Eq  .  (21)  . 

Increased  sampling  period:  This  will  be  discussed 
in  detail  in  the  next  section.  In  general,  AQ^_p 
A$.  AR  ,  AW  exist  and  are  parameterized  by  a 

K"*A  K  K 

scalar  t,  the  sampling  period;  therefore,  the  sensi¬ 
tivity  matrix  technique  of  Sec.  II-C  may  be  used. 

The  value  of  AR.  depends  in  part  on  what,  if  any  pre- 
smoothing  of  the  data  is  used . 
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(4)  Approximate  reference  model  dynamics:  The  common 
practice  is  to  represent  the  model  error  as  a  plant 
noise.  The  approximate  dynamics  are  regarded  as  tho 
re''l  dynamics  plus  noise.  The  difference  in  perfor¬ 
mance  is  then  between  the  use  of  the  full  and  optimum 
filter  and  the  full  and  optimum  filter  with  increased 
plant  noise:  *s  comPutecl  *or  AQj,  ^  and  A \Y°  to 

give  deterioration  in  estimator  performance. 


(5)  A  varying  model  parameter:  Assume  that  the  varying 

parameter  causes  a  A$.  ,  and  assume  that  this  change 

is  known  to  us  so  that  we  may  incorporate  it  into 
the  filter  reference  model  as  well  as  the  filter 
gain,  APfeyk  may  be  computed  from  Eqs ,  (17)  and 

(26)  with  optimal  B°  and  with  A$^j . 

(6)  Suboptimal  gains:  If  the  available  nominal  filter 

is  a  full  optimum  filter  then  is  seconti 

order  in  AW  through  B.  .  Using  the  error  transition 
K  K 

matrices  and  adjoint  matrices  of  Sec.  II-3,  it  is 
possible  to  specify  regions  around  the  optimal 
gains  W°  such  that  any  suboptimal  gains  within 
these  regions  will  produce  acceptable  performances. 


(7)  Expensive  observations:  Suppose  the  estimation  error 
at  T  is  of  major  interest.  We  should  locate  the  ex¬ 
pensive  observations  at  some  point  k  <  T  so  that 
AP^y^,  is  as  negative  as  possible.  This  information 
is  provided  by  the  error  transition  matrices  and  the 
adjoint  matrices  of  Sec.  II-B.  An  application  of 
this  is.  given  in  Sec.  II-E. 
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Ill  APPLICATION'S  TO  SAMPLING -PER  IOD  PROBLEMS 

There  are  two  types  of  problems  concerning  the  sampling  period.  The 
design  problem  is  to  find  a  set  of  sampling  periods  such  that  the  esti¬ 
mation  errors  are  within  certain  specifications.  The  sampling  periods 
may  or  may  not  be  uniform.  The  real-time  problem  exists  when,  for  one 
reason  or  another,  the  conditions  are  changed  from  the  design  values, 
and  one  attempts  to  adapt  to  these  changes  in  some  optimum  fashion.  In 
this  section,  we  shall  define  these  problems  and  give  methodologies  for 
their  solution.  An  illustrative  example  is  given  in  Sec.  III-E. 

A .  Design  of  Uniform  Sampling  Period 

The  sampling  points  shown  in  Fig.  4  are  equally  spaced  from  0  to 
T  with  period  t.  The  estimator  accuracy  PT/T  at  a  specified  time  T  is 
to  meet  a  certain  specification.  An  iterative  procedure  (Newton's 
method)  may  be  defined  as  shown  below. 


FIG.  4  UNIFORM  SAMPLING 
PERIOD 


Given:  .  . 

p0/_r  Q,  oQ/Zr,  a§/3 t,  oR/St,  Lt/t,  J* 

Find: 


Sampling  period 


such  that 


tr(LT/TPT/T* 


£  J* 


(65) 
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Algorithm; 


(1)  Select  as  an  initial  sampling  period,  and  solve  the 
recursive  equations  [Eqs.  (3),  (46),  and  (47))  for 
(P^yip)  and  (  ^P^yip/^T)  ^ 

(2)  Find  by 


<t2  -  T1)  tr^T/T(SPT/T/oT)1]  =  J*  -  tr 


T/TlT/T 


/Li 


or 


* 

/  \“ 

T2  =  T1  + 

J*  -  tr 

h 

LT/T  T/T j  x 

/tr [Lt/t(oPt/t/ot^] 

4 

• 

(66) 

Steps  (1)  and  (2)  are  then  repeated  until  Eq .  (65) 
is  satisfied. 


The  convergence  of  this  iteration  procedure  remains  to  be  proved.  How¬ 
ever,  iu  case  of  difficulty  one  may  take  a  sufficiently  small  step  to  at 
least  obtain  an  improvement  over  (PT^T)^,  i.e.,  for  A.  <  1 


~  /  Y 

-  /  sr 

T2  -  T1  *  X 

J*  -  tr 

lt/t(pt/t Jl 

/tr 

lt/t  (^t/t7^ 

B.  Design  of  yonuniform  Sampling  Period 

A  typical  nonuniforra  sampling-period  design  problem  may  go  like 
this.  From  results  of  Sec.  III-A  or  from  an  examination  of  the  computa¬ 
tional  capabilities,  the  total  allowable  number  of  sample  points  are  de¬ 
cided.  The  problem  is  to  reduce  the  terminal -error  covariance  by 
redistributing  the  sample  points,  while  keeping  the  total  number  the 
same.  To  do  this  we  may  divide  the  time  into  m  segments,  and  change 
the  sampling  period  uniformly  within  each  segment  as  depicted  in  Fig.  5. 
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Given: 


po/-i'  q>  R>  Sq/STj  a§/aT>  5r/St>  LT/T 

n  =  number  of  sample  points 
m  =  number  of  time  segments. 

Find: 

Sampling  period,  i\,  i  =  1,  2,  m, 

Et .  “  t .  . 

1  i~l 
n  =  n,  n  =  - - - 

i  i 

such  that 


(38) 


(69) 


J 


-  tr 


(70) 


is  minimized .  1 

'  i 

Discussion: 

Consider  T  ,  i  =  1,  2,  a,  asm  scalar  parameters.  The 

following  sonsitivity  indices  may  bo  computed  using  the  results  of 
Sec.  II. 


s 


i 


dtr(LT/TPT/T> 


i  =  1,  2, 


m 


(71) 


The  problem  is  then  equivalent  to  first  order  to  the  following  problem: 
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I 


Minimize  2  Sj  At, 
i  1 

ATi 


su 


*r)  (ti "  W  =  n 


Wo  must  realize  that  the  sensitivity  as  defined  hero  gives  only  an 
indication  of  the  change  in  performance  to  first  order,  and  the  results 
will  be  inaccurate  if  A^  are  too  largo. 

We  shall  therefore  limit  the  step  sizes  for  At^  by  adding  the 
following  linearity  constraint  to  Eq.  (72): 

UtJ 

i  /  n  o  \ 


From  Eq.  (72),  it  follows  that  a  necessary  condition  for  optimum 
distribution  points  is  obviously 


sl  “  s2  =  •  *  *  "  sm 


if  not,  we  may  always  obtain  an  improvement  in  performance  (a  reduction 
in  J)  by  moving  some  sample  point  from  a  segment  with  higher  s^.  A 
gradient  procedure  is  shown  below  for  solution  of  this  problem. 

Algorithm: 

(1)  Compute  the  sensitivity  indices  si  by  Eqs.  (52) 
and  (54)  . 

(2)  Select  two  time  segments  u  and  t,  that  have  respec- 

.  tively  the  min  (s  )  and  max  (s.).  n  points  are 
1  X  u* 

,  then  moved  from  the  u-th  segment  to  the  f-th  seg¬ 
ment,  until  constraint  (Eq.  (73)3  is  met  for  i  =  u 
or  i  -  t. 

(3)  If  the  linearity  constraint  is  reached  for  segment  £, 
further  improvement  may  bo  possible  by  moving  points 
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from  tho  u-'h  segment  to  the  segment  with  tho  next 
highest  s^  In  this  case,  repeat  steps  (1)  and  (2) 
until  all  segments  are  modified  or  until  tho  u-th 
segment  has  reached  the  constraint  [Eq .  (73)]. 

(4)  Recompute  the  s^  using  the  new  sampling  times,  as 
determined  above  and  proceed  to  step  (2) . 

(5)  Terminate  the  process  when  the  s^  are  sufficiently 
close  to  being  identical.  The  examples  in  Sec. 

III-E  illustrate  this  technique. 

The  sensitivity  indices  may  of  course  be  used  in  other  types  of 
gradient  procedures . 

C .  Real-Time  Allocation  of  Computing  Resources  to  Multiple  Trajectories 


Here  we  address  ourselves  to  the  problem  of  optimum  allocation  of 
limited  computation  facilities  to  multiple  trajectories  when  the  number 
of  trajectories  cannot  be  predetermined  accurately.  We  note  that  in 
case  xhe  number  may  indeed  be  predetermined,  then  the  algorithms  in  Secs. 
III-A  and  III-B  may  be  used,  with  slight  modifications,  to  obtain  optimum 
sampling  schedules  for  the  multiple  trajectories.  Although  many  types  of 
problems  may  be  formulated,  we  shall  consider  the  following  special 
formulation: 

(1)  Any  one  trajectoiy  is  to  be  filtered  a  fixed  length  of 
time.  The  terminal  estimation  errors  are  of  interest. 

(2)  The  initiation  and  termination  times  for  each  trajectory 
are  arbitrary.  They  are  therefore  likely  to  be  staggered 
in  time  to  amounts  that  cannot  be  prespecified. 

(3)  The  filtering  system  has  available  a  nominal  sampling 

rate  c^  for  the  i-tb  trajectory.  ‘  j 

(4)  The  computation  facility  capacity  may  be  characterized 

by  2  Thai  is,  the  facility  can  only  handle  the 

load 
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(75) 


E  °i s  *  - 

i 

l  a  number  denoting  the  capacity. 

(5)  The  allowable  real-time  modifications  aro  A  c^. 

(6)  The  criterion  for  the  modification  is  equal  degradation 
at  terminations  of  each  trajectory 


A  j 


(1) 


A  j 


(2) 

•—  •  •  • 


(76) 


where 


ji0  =  tr 


[l  Pa)l 
[jT/T  T/Tj  ‘ 


The  solution  is  simple  if  the  system  has  in  its  computer 

storage  a  proper  set  of  sensitivity  figures  as  follows: 

At  real-time  t,  the  i~th  trajectory  will  be  in  a  certain 

(i) 

filtering  stage  denoted  k.,  see  Fig.  6.  Let  sk 

(if  i 

be  the  sensitivity  of  J  wit1'  respect  to  c when  c 
is  changed  by  A  from  k^  to  T.  Then  A  obtained 
by  solving  the  following  set  of  equations,  is  che 
answer  to  our  problem: 


(1>  .  „  (2>  A 

\  A  C1  ~  Skg  A  C2  =  ’ * 

y~!  <ci  +  a  ci>  =  i 


(77) 


The  solution  is 


A  c 


A  c,  =  s^  A  c  /s' 

i  1  kf 


E 


1  i  s 


(i) 


(78) 


The  s^^  are  easily  precomputed  using  the  equations  in 
Soc.  II-E  for  sonsitivity  indices.  The  required  storago 
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for  s 


problem . 


depends  a  great  deal  on  the  particular 
If  various  possible  trajectories  have 


similar  sensitivities,  th'  a  one  set  of  s,  , 

’  k' 

k  =  0,  1,  . ..,  T  is  sufficient.  Further  simplifica¬ 


tion  may  be  effected  by  segmentation  of  the  time 


axis,  and  assigning  a  sensitivity  to  each  time 
segment  (see  Fig .  6) . 


D .  Real-Time  Maneuver  Compensation 

A  vehicle  in  motion  is  said  to  perform  an  unknown  maneuver  when  its 
trajectory  suddenly  deviates  a  large  amount  from  the  trajectory  generated 
by  the  filter  reference  dynamics.  Unless  we  know  when  or  how  the  vehicle 
will  maneuver,  we  are  forced  to  use  in  the  filter  a  model  of  the  dynamic 
equations  that  does  not  account  for  the  maneuvers.  This  causes  high 
estimation  errors  during  unknown  maneuvers. 

The  maneuvers  can  be  modeled  as  plant  noise  whose  magnitude  and 
occurrence  are  inferred  from  observation;  experience  shows  that  the  esti¬ 
mation  can  be  improved  by  adjusting  the  filter  gains  closer  to  optimal 
for  the  increased  plant  noise.  Our  experience  also  shows  that  the  speed 
of  adaptation  to  maneuvers,  even  with  the  stated  refinements,  is  limited 
by  the  sampling  period.  Three  or  four  sampling  periods  are  necessary  to 
correct  the  largo  maneuvor-induced  estimation  error.  The  direction  for 
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further  improvement  of  filter  performance  lies  obviously  in  increased 
sampling  rate  when  a  maneuver  is  detected. 


The  required  change  in  the  sampling  period  A T  may  be  computed  from 
the  inferred  acceleration  noise  increase  Aa  by  employing  the  sensitivity 
indices  of  Sec.  It-E.  We  shall  doex'ease  the  sampling  period  to  counter¬ 
act  the  effects  of  increased  acceleration  error,  which  leads  to  the 
following  equation: 


* 

n  ■ - 


3j„ 
k+l  . 
-3* —  Aa, 
oa,  k 
k 


where  BJ^^/Bt^  anc*  dJ^^/da^  are  PrecomPuted  sensitivity  indicies.  If 
J  ,  is  defined  as  the  root-sum-squared  position  error,  then  3j  /3t 
is  the  change  in  J  due  to  a  change  in  sampling  time  from  k  to  It  +  1; 

KtI 

3j  ,/da  is  the  change  due  to  acceleration  changes  from  k  to  k  +  1 . 

Kta  K 

Instead  of  the  one-stage  sensitivity,  we  may  use  the  multistage 

sensitivities  Bj,  /3t,  ,  3J,  /da,,  which  are  the  changes  in  roct-sum- 

k+m  k'  k+m  k' 

squared  position  error  m  stages  ahead  of  the  sample  point  k  when  the 
maneuver  is  detected.  Thus,  assuming  that  the  maneuver  acceleration 
uncertainty  (Aa)  is  maintained  for  the  m  stages,  we  have 


At  =  - 


where  the  sensitivity  indices  are  obtained  by  solving  the  recurrent 
equations  £Eqs.  (46),  (47),  (50),  and  (34)]  m  times  using  zero  initial 
values.  j 

E .  Examples 

The  procedures  discussed  in  Secs.  IIX-A  and  -B  will  now  be  illus- 

2 

trated  by  a  simple  estimator  problem  using  a  ,1/s  plant.  The  numerical 
values  used  are,  however,  on  the  order  of  what  one  might  encounter  in 
the  estimation  of  ballistic  trajectories. 

Example  1: 

Assume  that  the  ballistic  vehicle  moves  in  a  straight  line  with  no 
other  driving  force  than  tj>e  acceleration  noises.  That  is,  lot  p  be  the 
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40 


for  10-g  acceleration  error,  and 


for  initial  position  and  velocity  standard  deviations  of  1000  ft  and 
1000  ft/sec. 

r  varies  in  the  program,  with  0.1  sec  as  its  nominal  value. 

The  total  time  of  the  estimation  process  is  5  sec,  which  is  divided 
into  five  segments  of  1  sec  each.  Within  each  segment,  the  sampling 
points  are  equally  spaced.  Thus,  when  the  number  of  sampling  points  are 
changed  from  10  to  8  in  a  certain  segment,  the  sampling  period  is  changed 
from  1/10  sec  to  1/8  sec. 


Case  1;  Plant  Noise  is  1  g 

First  we  use  the  (10,  10,  10,  10,  10)  sampling  scheme — numbers  in 

the  parentheses  denote  the  number  of  sampling  points  in  each  segment. 

The  position  estimation -error  covariance  is  shown  in  curve  a  of  Fig.  1? 

2 

where  a  terminal  position  error  covariance  of  876  ft  is  observed. 

Now,  suppose  the  computation  capability  of  the  system  is  such  that 

only  40  sample  points  are  allowable  in  the  5-sec  interval  instead  of  the 

proposed  50.  First,  we  modify  the  filter  in  the  most  obvious  way, 

namely,  using  the  scheme  (8,  8,  8,  8,  8) .  The  results  are  shown  in 

curve  b  of  Fig.  7;  the  terminal  error  has  deteriorated  21  percent  to 
2 

1060  ft  .  We  will  now  use  a  better  sampling  scheme  in  order  to  decrease 
the  terminal  error.  For  this,  wo  need  the  guidance  of  a  sensitivity 
computation. 
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segment.  Allowing  a  reduction  of  50  percent  for  linearity  as  discussed 
m  Sec.  III-B,  the  number  of  sampling  points  is  . educed  within  the 
second  segment  from  10  to  5 .  Since  me  next  lower  sensitivity  is  in 
segment  A,  the  remaining  reduction  is  carried  out  in  segment  3;  from  10 
to  5.  With  the  new  scheme  of  (10,  5,  5,  10,  10),  the  terminal  position 
error  covariance  change,  from  the  sensitivity  indicos,  should  be: 

AP  =  s(t2>  X  At 2  +  s(t3)  X 

-  227  X  (0.2  -  0.1)  +  33  L  X  (0.2  -  0.1)  =  55.3  ft2 


The  error  covariance  with  (10,  5,  5,  10,  10)  is  computed  and 

plotted  in  curve  c  of  Fig.  7.  The  terminal  position-error  covariance 

2  2  2 
of  894  ft  represents  an  increase  of  only  18  ft  (compare  with  55.8  ft 

as  predicted  above)  over  the  scheme  using  (10,  10,  10,  10,  10) .  It  is 

interesting  to  note  that  10  sample  points  may  be  removed  from  the  right 

places  with  very  little  effect  on  the  terminal  estimation  accuracy. 

The  onlv  additional  labor  involved  is  the  computation  of  the  sensitivity 

indices  s^^)  * 


.,  with  L_ 
k/k  T/T 


.  US'J  AM  £ 

■  [:  a. 


The  diagonal  elements  of  the  adjoint  matrices  are  plotted  in  Fig. 

9.  The  curve  a  shows  the  (1,  1)  element  of 
which  may  be  interpreted  as  the  sensitivity  of  the  terminal  position- 
error  covariance  to  the  k-th  position-error  covariance.  Similarly,  curve 
b  shows  the  sensitivity  with  respect  to  the  k-th  velocity  error  covariance 
i.e.,  the  (2,  2)  element  of  1.^,^.  This  plot  provides  additional  insight 
into  the  estimation  problem  beyond  those  given  by  the  sensitivity  in¬ 
dices.  The  design  of  an  estimator  may  be  greatly  improved  with  this 
insight.  Referring  again  to  Fig.  9,  it  can  be  seen  that  in  the  4-th  seg¬ 
ment  (3  to  4  sec),  velocity-error  sensitivity  predominates.  This  indi- 

i 

cates  that  if  e  perform  a  velocity  measurement  at  that  rime,  terminal 

estimation  accuiacy  may  be  much  improved.  To  obtain  some  definite 

quantities,  the  velocity  measurement  is  assumed  to  have  an  error  co- 

2 

variance  of  100  (ft/soc)  .  We  shall  perform  the  velocity  measurement  at 
3.5  sec,  at  which  time  the  nominal  velocity  covariance  is  413  (fl/sec) 
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SECONDS 

FIG.0  TERMINAL  POSITION  SENSITIVITY  TO  COVARIANCE 
AT  TIME  k,  l~g  PLANT  NOISE 

from  computations.  With  a  single  measurement,  the  velocity  estimate  im- 

2 

provement  is  at  least  413  -  100  «  313  (ft/sec)  .  Since  curve  b  in  Fig. 

9  snows  a  sensitivity  of  0.4  at  3.5  sec,  the  terminal  position  accuracy 

2 

is  expected  to  improve  by  0,4  X  313  =  125  ft  — an  improvement  of 
125/876  =  14  percent , 

Further  insight  that  may  be  obtained  from  the  adjoint  matrix  of 
Fig.  6  is  that  although  position  measurements  are  made  in  the  3  to  4-sec 
segment,  their  predominant  purpose  is  to  obtain  better  velocity  estimates, 
which  in  turn  improves  the  terminal  accuracy.  Given  a  choice  of  position 
or  velocity  measurement  improvement  in  3  to  4  sec,  one  should  take  the 
velocity  improvement  if  Fig.  S  is  applicable  to  the  system. 

Case  2:  Plant  Noise  is  10  g 

With  the  plant  noise  increased,  we  would  expect  that  what  the  esti¬ 
mator  does  initially  has  less  effect  on  the  terminal  es t ima t ion /error ~ 
This  fact  is  dramatically  illustrated  in  the  following. 

* 
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The  position-error  covariar.co  is  shown  in  curve  a  of  Fig.  10  for 

?  (10,  10,  10,  10,  10)  sampling  schemo .  The  terminal  position-error 

2 

covariance  is  2249  it  .  The  terminal-error  covariance  sensitivities 
to  sampling  period  are  shown  in  Fig.  11.  It  is  seen  that  changing  the 


sampling  period  in  the  first  two  segments  will  have  virtually  no  effect 
on  the  terminal  error.  Therefore,  the  reduction  in  sampling  period 
should  be  confined  to  the  first  two  segments,  0  to  2  sec.  According  to 
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FIG.  11  SENSITIVITY  OF  TERMINAL  ERROR  TO  SAMPLING 
PERIOD,  10-ji  PLANT  NOISE 


this  argument,  a  (5,  5,  10,  10,  10)  scheme  is  tried  with  the  results 

2 

plotted  in  curve  c  of  Fig.  10.  The  terminal  error  of  2250  ft  ,  as 

2 

compared  with  2249  ft  ,  is  almost  exactly  the  same  as  the  (10,  10,  10, 

10,  10)  scheme.  If  the  same  10~point  reduction  were  taken  uniformly. 

2 

namely  the  (8,  8,  8,  8,  8)  scheme,  the  terminal  error  would  be  2600  ft 
as  shown  in  curve  b  of  Fig.  10 — a  15.5-percent  increase. 

Figure  12  shows  the  sensitivity  of  the  terminal  position  covariance 
to  the  k-th  covariance  (diagonal  elements  of  the  adjoint  matrix  L  .  ) . 
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FIG.  12  TERMINAL  POSITION  SENSITIVITY  TO  COVARIANCE, 

10-g  PLANT  NOISE  / 

/ 

Similar  to  the  1-g  case,  we  see  from  this  plot  the  advantage  of  making^ 
a  velocity  measurement  at  4.3  sec.  Assuming  3  measurement  covariance 

o 

of  100  (ft/sec)  ,  the  terminal  position  covariance  is  expected  to  de¬ 
crease  by  approximately  the  amount 

L  (2,2)  X  CP  (2,2)  -  100]  =  (0.05)  X  (8240  -  100)  =  407  (ft2)  , 

R/k  K/K 

which  represents  a  407/2249  =  18  percent  decrease. 

Example  2: 

Ir  this  example,  we  shall  point  out  the  precautions  that  should  be 
exercised  in  deriving  sensitivity  indices  for  smoothed  measurements. 
Under  certain  conditions  the  sampling-period  sensitivity  may  become 
negative,  indicating  one  should  update  less  frequently  in  order  to  re¬ 
duce  terminal  error.  While  tnis  may  seem  to  contradict  our  engineering 
intuition,  mathematically  it  is  perfectly  rigorous.  Nevertheless,  if 
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this  becomes  unacceptable  for  any  reason,  it  is  essential  to  analyze 
carefully  the  assumptions  concerning  the  measurement  smoothing  and  the 
plant  noise. 

In  Example  1,  assume  the  measurements  are  smoothed  such  that  the 
measurement  eovarianco  is 


4  2 

Note  that  when  T  =  0.1  sec,  the  nominal  sampling  period,  R.  is  10  ft  , 
the  value  used  in  Example  1.  In  Fig.  12,  the  sensitivities  s(f.)  are 
plotted,  for  plant  noises  of  1  g  and  10  g.  Both  cases  show  negative 
sensitivities  toward  the  end  of  the  estimation  process,  meaning  that  the 
terminal  accuracy  is  improved  for  more  widely  separated  sample  points. 

To  verify  the  negative  sensitivity,  the  covariance  equation  is  re¬ 
computed  for  the  10-g  case  with  the  number  of  sample  points  reduced  from 


SEGMENT  NO. 

?***!••'*»• 


FIG.  13  SENSITIVITY  OF  TERMINAL  ERROR  TO  SAMPLING 
PERIOD,  SMOOTHED  MEASUREMENTS 
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10  to  6  in  tho  Inst  segment.  The  new  terminal  position  covariance  is 

2  2  9 

2070  ft  ,  a  reduction  of  179  ft  from  the  original  2249  ft  . 

The  negative  sensitivity  arises  from  the  fact  that  the  reduction 
in  measurement  covariance,  Eq .  (87),  outraces  the  increase  in  plant 
noise,  Eq.  (86),  as  sampling  period  increases.  We  shall  now  examine 
the  validity  of  these  assumptions  about  the  noise. 


It  may  be  shown  that  if  tho  plant  noise  is  approximated  by  a  white 
noise  in  the  continuous -time  description  of  the  dynamical  system,  then 
its  discrete  description  will  have  a  noise  covariance,  as  described  by 
Eq .  (86),  proportional  to  T,  However,  if  the  plant  noise  is  meant  to 
represent  mathematical  modeling  errors,  this  may  not  be  a  valid  assump¬ 
tion.  A  better  noise  model  is  perhaps  an  acceleration  noise  that  re¬ 
mains  constant  over  T,  where  its  magnitude  is  a  random  variable,  zero 
moan  and  Gaussian  in  distribution  with  standard  deviation  a.  For  a 
given  time  Interval  t,  the  plant  noise  covariance  matrix  would  then  bo 
better  expressed  as 


Q  = 


0 

(at)2 


(88) 


The  fourth  and  second  powers  of  T  here  indicate  that  as  the  sampling 
period  t  increases,  the  true  plant  noise  is  likely  to  increase  more 
rapidly  than  those  assumed  in  Eq.  (86).  This  will  cause  the  sampling 
period  sensitivities  to  tend  towards  positive  values. 

Returning  to  the  question  of  the  measurement  noise  covariance, 
we  see  that  the  form  of  Eq.  (87)  is  valid  only  if  the  data  are  "per¬ 
fectly”  smoothed.  Namely,  the  data  must  be  fitted  to  a  curve  repre¬ 
senting  the  precise  output  of  the  dynamical  system.  Yet  ir.  practice, 
data  are  smoothed  using  arbitrary  curves  such  as  straight  lines  or 
polynomials.  In  doing  so,  additional  errors  are  introduced  beyond  those 
represented  by  Eq .  (87).  A  more  truthful  representation  of  the  smoothed 
measurement  is  perhaps 


49 


> 


a  <  1 


„  10 

R,  =  - 

k  a 
T 


The  effect  is  that  as  sampling  period  increases,  the  noise  covariance 
does  not  decrease  as  rapidly.  This  will  also  tend  to  move  the  sensi¬ 
tivity  to  the  positive  side. 

We  have  soon  that  any  refinement  of  our  noise  assumptions  tends  to 
move  away  from  a  negative  sensitivity  index  for  sampling  period.  It  is 
thoroforo  doubtful  that  the  negative  sensitivity  should  be  taken 
seriously  as  a  significant  phenomenon. 
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IV  ONE-STAGE  TRADE-OFF  STUDIES  USING  A  SIMPLIFIED  MODEL 


A .  One-Stage  Trade-Off 

The  purpose  of  this  section  is  to  provide  formulas  and  curves  that 
will  promote  a  general  understanding  of  the  relationship  between  filter 
performance  and  various  parameters,  and  the  resulting  trade-offs  botweun 
these  parameters.  Such  understanding  is  necessary  when  one  is  doing, 
for  example,  trade-off  studies  between  sampling  period  and  plant  noise, 
sampling  period  and  measurement  accuracy,  plant  noise  and  measurement 
accuracy,  etc. 

Since  our  interest  is  in  deriving  qualitative  relationships  that 
are  easily  computable,  we  shall  limit  our  discussion  to  the  following 
case.  These  assumption*  should  be  kept  in  mind  when  the  results  are 
applied  to  practical  problems. 

2 

(1)  1/s  plant:  The  state  equation  is 


x  = 


0 

•  r 

1 

T** 

0 

o_ 

x  +  u  , 

or  x,  ,  = 
k+1 

0 

1  _ 

Xk  +  Uk  • 


(89) 


where  x  is  a  2-vector  composed  of  position  and 
velocity,  u  is  the  plant  noise,  t*  is  the  sampling 
period . 

i 

(2)  Position  measurement:  The  observation  equation  is 


-  H\  *  vk  - 11  03  \  >  <90) 

where  v  is  the  observation  noise,  E[v^]  =  0, 

E[vk]  =  V 
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(3)  Plant  noiso: 


E[uk]  =  0 


E[\  \]  - 


(4)  u  ,  v  ,  k  =  0,  1,  2  ...  arc  Gaussian  white  and 

K  K 

uncorrolnted . 


(91) 


Tho  formula  we  shall  dovolop  is  for  tho  covariance  of  the  estima¬ 
tion  errors  from  k  to  k  +  1  sampling  point.  They  apply,  therefore,  only 
to  local  considerations.  The  behavior  of  the  error  covariance  matrix  is 
depicted  symbolically  in  Fig.  14. 


FIG.  14  PREDICTION  AND 

UPDATING  STAGES  IN 
KALMAN  FILTER 


From  P^  ,  ^  to  P^^  prediction  of  the  state  is  performed;  the 

covariance  usually  grows  because  of  the  velocity  error  and  the  plart 

noise.  From  P  ...  to  P,  ,,  ,  the  k-th  measurement  is  used  to  update  the 
K/k-1  k/V 

state;  the  reauction  in  the  covariance  is  a  function  of  the  measurement 
accuracy. 

Let 


Pk-l/'k-l 


k-l/k-1 


i-l/k-1 


(92) 
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(93) 


k/k-1 


WkA-i  (Pxv)k/k-i 

(Pxvi/k-i  Wk/k-i 


k/k 


- 

(p  ) 

(p  ) 

'  'k/k 

'  XV  k/k 

(Pxv) 

'  x  'k/k 

(Pv) 

'  V/k/k 

(94) 


Koto  that  tbo  diagonal  olomonts  of  in  Eq .  (92)  aro  unity, 

Pr  ^  may  always  bo  brought  to  this  form  by  a  normalization  procoss 
which  is  discussed  in  Appendix  C, 

The  prediction  process,  Pj._i/k-i  to  Pk/k-l>  is  Eiven  by  the  equation 


* 


k/k-1  "  *k-l  ‘  k-l/k-1  ‘k-l  T  Qk-1 


*T 
2.  ,  + 


Under  our  assumptions,  wo  have 


(95) 


a  1  +  2  | 

k/k-1 

=  (p  \ 

k/k-1 

=  1  +  q 

k/k-1 

V 

(96) 


The  updating  process,  P^/k-1  to  is  £*ven  by  the  following 

equation,  assuming  the  optimal  gain  is  used: 


pk/k  -  w  -  pk/k-i  kT  Ka-1  "T  *  *■) 

Using  the  assumptions,  wo  have 


-1 


HP. 


k/k-1 


(97) 
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may  bo  expressed  directly  in  terms  of  b>'  combining  Eqs, 


(96)  and  (98); 


(S9) 
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For  trade-off  studios,  we  need  tho  sensitivity  of  p  with  respect 

K/  K 

to  various  parameters.  Those  are  easily  derived  using  tho  result  (see 
Sec.  II-C)  that  if  P^/k-1  and  ^  arc  functions  of  a  scalar  parameter  n 
and  if  VV  is  chosen  optimally  or  fixed,  than 


Pk/k-l  '  on  (5k-l  Pk-l/k-l  $k-l)  +  5n  %-l 

h  Vk  = (I  -  V»  (In  w) <x  -  V)T  +  wk  ih  \)  wi 


(100) 


.-1 


\  -  pk/k-l  »T  (h  pk/k~l  «T  +  R)  -  °ptiraal  «•*» 


or 


W  -  fixed 
k 

Let  us  choose  the  parameters  r,  q  ,  qy,  and  R^  for  a  trade-off 
study.  Furthermore,  q  ,  qy,  and  R^,  and  §  are  dependent  on  sampling 
period  (t),  and  qy  on  acceleration  error  (Of),  and  R^  on  parameter 
(8): 

qx  *  %cia>  T>  »  qv  =  %(a’  T) 

Rx  =  V3'  T)  (101) 

5  Hr) 

The  parameters  are  then  or,  8  .  and  T; 

Pk/k-l  =  ^Wk-l^0^  T) 

(102) 

Pk/k  =  Pk/k(3,  r>  Pk/k-l^ 

Using  Eq .  (96),  the  following  equations  may  be  written 
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dp. 


k/k-i 

da 


3q* 

55“ 


(103) 


Substituting  Eq.  (103)  into  Eq.  (100),  we  obtain  the  following  expressions 
for  the  elements  of  oP^^/da,  the  sensitivity  to  the  plant  noise  parameter 
a: 


(l  -  k^2 


dq 

x 

55“ 


5(p.  ^ 


xv4/k  3qx 

_iiA  .  (1  -  v  (-  v  ^ 


(104) 


5(Pv) 

•  'k/k 

55 


_  2  ^x 

*2  da  +  da 


where 


k,  = 


W 


k/k-l 


1  R  +  /P„\ 


M 


and 


*2  = 


k/k-l 


VP,,v)kA-l 

“*  *  (Mk/k-l 


(105) 
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1  -  k.. 


1  "  Rx  +  (P-) 

X  \  " /k/k-1 


Similarly,  for  tho  sampling  period  parameter  r: 

MP*L,  ,  r  ,  .  *c 


-  k  )2  2r  +  2  'p  \  +  i  I  +  k? 

1  L  ,XV,k-l/k-l  1 


(p*v)k/k  r  .  .  so  i  sr 

-ST^  - (1  -  V  -  k2|2T  * -kA  , +  sr  * 1  -  ki  k2  sr 

L  L  #k-l/k-l  _J 

^  (?v  )•  'v  o  f~  Sq  ~1  3q  dR 

^  =  k2  2T  +  2  (pxv )  +  §7-  -  2k2  +  5T*  +  k2  5t“ 

k-l/k-1  __ 


(106) 


'k/k  .  2 
St  ‘  "  *2 


Sq  _  dR 
v  ,2  x 

ir“  +  k2  §t” 


And  similarly,  for  the  measurement  noise  parameter  3: 

Mp*L/t,  o  hK 


4 'k/k  2  °Rx 

55 —  "  ki  5T 


(Pkv) 


v'k/k  „  „  5kx 

5 —  *  kl  k2  §T 


(107) 


k/k  .2  &Rx 

r~  =  k2  sr  • 


Example  1;  v 

Let  us  illustrate  the  use  of  the  above  equations  by  a  problem  fre¬ 
quently  encountered  in  Kalman  filtering:  the  trade-off  between  model 

2 

accuracy  and  sampling  period  (1/s  plant  approximation) .  In  an  attempt 
to  reduce  computation  time,  one  wishes  to  use  a  simplified  dynamics 
model.  However,  in  doing  so,  the  state  estimate  error  increases.  This 
may  be  compensated  by  sampling  (processing  data)  more  frequently,  which 
increases  the  computation  time.  One,  therefore,  needs  a  set  of  alterna¬ 
tives  on  sampling -period  and  model  accuracy  to  analyze  their  computa¬ 
tional  requirements. 
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Trade-ofi  between  plant  noise  and  sampling  period  may  also  occur  in 
the  estimation  o i  maneuvering  reentry  vehicle  tra joctorios,  as  discussed 
in  Sec,  XIX-D.  A  maneuver  may  be  modeled  as  an  increase  in  the  plant 
noise  that  causes  large-  than  expected  estimation  errors  if  the  sampling 
period  is  held  fixed.  By  sampling  more  frequently,  this  error  may  con¬ 
verge  more  rapidly. 

Let  plant  noise  be  represented  by 


)  -s' 


12  4 

t  a  t 


> 


where  x  and  a  are  respectively  the  'normalized  sampling  period  and  nor¬ 
malized  acceleration  standard  deviation. 


,  .2  2  2 

q  =  '.Of  T>  =  a  X 


(  - 
'  (108) 


And  lat  the  measurement  noise  be  independent  of  sampling  period.  Then, 


Sqx  1  4 

§oT~  ~  2  ^  T 


3 


T 


(109) 


oor 


T 


Let  Aar  represent  the  increase  in  plant  noise  from  normal  to  high;  At, 
the  required  change  in  sampling  period  tc  bring  the  position  estimate 
error  buck  to  its  original  value^  is  obtained  from  the  first  equations 
of  Eqst  (104)  and  (105); 
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Aa  =  - 


MO 

>  *  i' 


k/I: 


&T 


At 


2  Sqx 

(1  -  kx)  to 


(1  -  k  )2  2t  +  2(p  )  +  c~ 

l  1  [_  l  xv4-i/k-i  57  J 


*1. 


(110) 


2  SRxl 

kI  §^}(-  At) 


j  Of  T4  (AOf)  = 


2T 


+  2  (pxv  )  -  a 

V  'k-l/k-l 


2  3 
T 


(-  At) 


(At)  =  - 


|or  t4 


2t  +  2  (p  \  +  a2  T3 

' xv  4-i/k-i 


(Aar) 


(111) 


(112) 


2  3 

When  o'  t  is  snail,  ,at/t  Si  0:  when  large,  At/t  s:  -  1/2  Aar/or.  In  the 
maneuvering  reentry  vehicle  example  above,  this  equation  may  be  used  to 
change  the  sampling  period  by  the  amount  At  after  estimating  the  noise 
increase  Aar.  Aar  nay  be  inferred  from  the  measurement  residuals. 


It  should  be  noted  that  Eq.  (102)  is  given  in  normalized  quantities; 
see  Appendix  C  for  reconversion  into  the  original  variables. 

Example  2: 

2 

The  trade-off  between  measurement  noise  and  sampling  period  (i/s 
plant  approximation)  will  now  be  considered.  In  radar  observation  of 
reentry  vehicles,  this  question  may  come  up  in  different  phases  of  de¬ 
sign  and  operation.  In  the  design  phase,  tnere  is  the  question*  of  proper 
balance  between  radar  accuracy  and  data  processing  requirement.  For 
example,  if  the  radar  noise  is  reduced,  the  sampling  period  may  be  in¬ 
creased — meaning  less  data  processing.  The  measurement  noise  may  also 
change  during  operation;  for  example,  damage  to  the  radar  elements,  or 
splitting  of  the  array  into  suberr&ys  for  simultaneous  observation  of 
multiple  targets  will,  in  general,  increase  the  noise.  This  may  be 
compensated  by  faster  sampling. 
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To  coraputo  tho  change  in  sampling  period  necessary  to  compensate 
for  the  changed  measurement  noiso,  wo  may  use  tho  following  formula: 

3(Px)  *(px) 

V  'k/k  '  K./V  n- 

- - -  A3  = - §-T -  At  (1, 


(113) 


which  becomes,  upon  using  Eqs.  (106)  and  (107),  for  a  local  correction 


v2f  *  'tr 


At  .  -  (114) 


ti  the  plant  noise  is  q_  =  1/4  a  r  and  tho  measurement  noiso  is 


\  • B/T  - 


(115) 


which  represents  respectively  model  acceleration  error  and  presmoothed 


measurements,  Eq.  (114)  may  be  rewritten  as 


.  ?r  rx 

IuWka-i 


2t  +  2 


/  \  ^  o 

(Pxvj  +  «  T 

'  'k-l/k-l 


B  A- 

5. 


(116) 


-  1  + 


(TRx) 


2  2T  4-  2  (p  )  +  <2?  t 

V  'k-l/k-1 _ 

1  +  2  fp  ^  T+T2+q 

'  XV 'k-l/k-1 


2—  f  '  (U7> 


o 

when  T  /3  is  large,  At/t  a:  0;  when  small,  At/t  s:  a3/3. 

?■* 

Normalized  variables  are  used  in  Eq .  (117);  Appendix  C  gives 
equations  for  reconversion  to  the  real  variables. 

B .  One-Stage  Sampling -Period  S*  isitivities 

In  this  section,  plots  are  presented  giving  the  sensitivity  and  the 
reduction  of  estimation-error  covariance,  in  one  stage  of  Kilman  fil¬ 
tering,  as  functions  of  sampling  period  for  various  types  of  plant  and 
measurement  noises.  Using  these  plots,  the  effect  oi  sampling -period 
variations  to  local-error  variations  may  be  estimated  quickly.  Their 
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effects  on  orrors  at  later  times  can  bo  estimated  using  the  udjoints, 

Sec.  II-B.  The  dynamical  system  is  a  double  integrator  [see  Eq .  (99)] 
subject  to  random  acceleration  excitation;  the  jncasurod  quantity  is 
position  [seo  Eq.  (90)].  Normalized  quantities  are  used.  Appendix 
C  shows  the  relationships  between  the  actual  values  (donoted  by  a  super 
*)  and  the  normalized  quantities  (unstarrod  quantities)  to  be  as  follows; 


(119) 
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(125) 


r 

x 


-l/k-l 


(126)  • 


(127) 


(d  )  .  the  predicted  next-stage  position  covariance,  and  (Px)k/k* 

k/k-1* 

the  correct  ,d  next-stage  position  covariance,  are  plotted  in  Fig.  15, 
Using  the  following  equations  [see  Eqs.  (89) -(99)), 


I 


k/k-1 


2 

S  1  +  at  +  T 


(128) 


*  Nv*-x 


(129) 


The  parameters  are,  besides  (Px>k/k_!  and  T>  the  P°&ition  »easure- 
mett  noise,  r  ,  and  the  time  rate  of  change  of  the  predicted  covariance, 

denoted  by  a: 


a 


S  2 


k -l/k-l  ■  : 


(130) 


if  the  plant  noise  q^  is  independent  of  the  sampling  period  T, 
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Tho  vulue  of  a  is 


=  2(p*v)  '  + 

'  *  ;k~l/k-l 


(131) 


if  tho  plant  noise  q  depends  on  tho  sampling  period,  o.g.,  q  =  or . 

x  x 

=  constant,  if  position  data  is  not  smoothed.  (132) 


r =  r/r,  if  position  data  is  perfectly  smoothed 
(r  is  a  position  noise  parameter) . 


(133) 


Figure  15  is  organized  as  follows:  the  lower  horizontal  axis  is 
for  t,  the  vertical  axis  for  (Px)]</k~i>  and  t^ie  uPPer  horizontal  axis 
for  (Px^k/k*  Therefore,  if  the  problem  is  to  find  (Px^/k  *or  a  £iven 
set  of  T,  r  ,  and  a,  we  start  from  the  lower  horizontal  axis,  where  the 
given  7  is  located ,  We  then  traverse  up  vertically  until  the  appropriate 
r  curve  is  reached.  (px)  can  now  be  read  from  the  vertical  axis. 

To  continue,  we  traverse  horizontally  to  the  curve  with  appropriate  value 
of  a.  The  upper  horizontal  axis  now  gives  the  answer  on  (Px^k/k*  For 
other  types  of  problems,  the  stated  procedure  may  be  modified  easily. 

Figures  16  and  17  show  the  relationship  between  the  sensitivity, 
(ipx/pz)^j{/(iT/T) ,  and  T  for  a  =  0  and  1.  The  equation  for  these 
figures  is  easily  derived  from  Eqs.  (12S)  and  (129): 


*L\  _ 

T  )  ~ 


t  (a  +  2t> 


(134) 


(1  +  ar  +  r  ) 


Note  that  this  sensitivity  is  dimensionless,  relating  percentage  change 
in  (px).,,  to  percentage  change  in  t*: 


/{§?)*  (f)  im  ■ 

J  '  'k/kf 


(135) 


Two  examples  are  given  below  illustrating  the  use  of  Fig.  15. 
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(Aps/px)  /(Ar/t) 


TA*SHI*UI 


SAMPLING-PERIOD  SENSITIVITY  OF  ONE-STAGE 
KALMAN  FILTERING,  o  =■  0 
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To  obtain  values  of  (Px^k/.K  for  T  of  0.187  and  0.374,  tho  dotted 

lines  in  Fig.  15  are  traversed  from  t  axis  to  (pv),  axis.  Tho  results 

A  k/K 


(p  )  =0.92  for  T  =  0.187 

V  x/k/k 

Ip  \  =1.06  for  t  =  0.374 

'  X/k/k 


(139) 


The  conclusions  are  therefore  thus:  If  a  sampling  period  of  0.1 
sec  (t*  =  0.1)  is  used,  the  one-stage  position  covariance  reduction  is 
0.92,  from  3,422  to  3,150.  If  the  sampling  period  is  increased  to  0.2 
sec,  the  position  covariance  increases  by  a  factor  of  1.06,  from  3,422 
to  3,630.  Furthermore,  this  increase  is  due  mainly  to  velocity  errors 
rather  than  to  plant  noise;  this  may  be  seen  in  Eq.  (138),  where 
(Pxv)k_^/k-1  's  due  to  velocity  errors,  and  a  is  due  to  plant  noise. 

These  values  are  verified  by  Fig.  7  at  1  sec. 


Example  2: 

Sampling-period  change  with  smoothed  measurement 

Assume  all  quantities  have  values  identical  to  the  last  example 
with  the  exception  of  r^: 


r 

x 


0.187  X  2.92 
T 


(140) 


For  T*  =0.1  and  0.2,  r^  is  2.92  and  1.46,  respectively.  The  first 

case  t*  of  0.1  is  read  from  Fig.  15  exactly  as  in  the  last  example, 

which  gives  (p„),  „  =0.92.  For  t*  =  0.2,  we  have  to  use  the  r  =  1,46 
x  k/k  x 

curve  (approximated  as  shown  ia  dotted  line  by  rx  =  1.50),  obtaining 
<Px>k/k  =  °*8* 

Based  on  the  values,  we  have  the  conclusion  that  for  larger  posi¬ 
tion  covariance  reduction  using  smoothed  data,  Eq.  (14C),  one  should 
use  a  sampling  period  of  0.2  sec  compared  to  0.1  sec.  If  this  seems 
unreasonable  according  to  engineering  intuition,  one  should  refer  to 
the  discussions  in  Example  2  of  Sec.  III-E. 


For  t*  betwoen  0,1  and  0,2  (r  between  0.187  and  0.374)  orvo  may 
interpolate  using  the  line  shown  in  Fig.  15.  In  the  smoothed  data 
case  then,  this  line  takes  the  place  of  constant  r^  linos  of.  the  non- 
smoorhed  data  case, 

Perhaps  the  greatest  utility  of  Fig.  15  is  in  obtaining  rough  and 
quick  estimation  of  the  filter  characteristics  at  the  operating  points. 
For  example,  when  is  small  and  when  ^Px^/k-1  changes  in 

sampling  period  do  not  affect  (px)^^  very  much — see,  as  specific  values, 
Tx  ~  0,5>  f‘  "  **  and  1  =  1  in  Fig.  15.  Another  example  is  the  trade¬ 
off  example  shown  in  the  following. 

Example  3: 

Trade-offs 

Let  the  filter  operation  be  represented  by  the  two  points  a  and  b 
in  Fig.  15,  representing  T  =  1,  a  =  1,  and  r ?  =1.  <px)  is  0.75. 
Suppose  in  order  to  reduce  computational  load  we  wish  to  change  t  from 
1  to  2;  we  have  a  choice  of  either  improving  model  accuracy  or  improving 
measurement  accuracy  to  maintain  (px)  .  at  0.75. 

K/  K 

First  let  us  change  model  accuracy  while  r^  is  held  fixed.  As  T 
is  changed  to  2,  a  =  -  1  is  required  (point  d)  to  maintain  (Px^/^  at 
0,75.  If  ^Px^k-i/k-l  *s  Positive,  a  negative  a  is  impossible  because 
by  Eq.  (131)  Of  is  a  positive  number.  This  leaves  us  the  only  choice  of 
reducing  the  measurement  noise.  This  is  represented  by  the  point  c. 

The  required  r^  is  about  0.8.  The  measurement  noise  covariance  there¬ 
fore  needs  to  be  reduced  by  (1  -  0.8)/l  =  20  percent. 


V  CONCLUSIONS  AND  FUTURE  WORK 


We  have  given  techniques  for  sensitivity  analysis  of  the  Kalman 
filter  with  respect  to  simultaneous  variations  in  measurement  no iso. 
plant  noise,  dynamic  model,  sampling  period,  and  filter  gain.  These 
analytical  techniques  will  greatly  aid  the  design  and  evaluation  of 
Kalman  filters  and  other  types  of  filters.  Two  basic  assumptions  were 
used: 

/ 

(1)  There  are  nominal  quantities  about  which  variations  / 
may  be  taken. 

(2)  The  estimation-error  covariances  are  the  filter 
performance  measures. 

Future  wox’k  shall  be  the  application  of  the  techniques  to  the 
problems  described  in  Sec.  II-G. 
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APPENDIX  A 


ACTUAL  COVARIANCES  IN  EXTENDED  KALMAN  FILTER 


The  extended  Kalman  filter  is  becoming  an  important  technique  esti¬ 
mation  of  nonlinear  dynamical  system.  The  purpose  of  this  appendix  is 
to  give  expressions  for  the  expectations  and  of  the  estimation-error 
covariances  using  the  extended  Kalman  filter,  and  to  reconcile  them  with 
the  covariance  equation  of  the  filter.  The  discrete  time  case  shall  bo 
considered . 

The  system  is  described  by 


x  =  f  (x  ,  w,  > 
k+i  k  k'  k 


*  W  V 


(A.l) 


We  note  that  the  dynei.ic  equations  of  Sec.  II,  Eq .  (1>  are  a 
special  case  of  the  above  equations. 

We  will  analyze  the  following  filter: 


*k/k-l  =  fk-l(*k-l/k-l'  0> 

Vk-1  ■  VVk-i'  0) 

x,  .  =  x,  ,,  ,  +  W,  (z,  -  z.  ,  .)  , 

k/k  k/k-1  k  k  K/k-1  ’ 


(A. 2) 


where  f  and  h  are  nonlinear  functions  with  sufficient  smootheness  for 
our  later  derivations,  x  is  the  state  to  be  estimated,  z  the  measure¬ 
ment,  and  w  ar.d  v  the  plant  and  measurement  noises.  The  noise  are 
assumed  to  bo  zero  mean  and  uncorrelated  both  to  each  other  and  in  time. 
W  is  the  filter  gain;  the  super-hat  symbol  denotes  the  estimated 
quantities. 
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(A. 6) 


_ _ _  f 

( ‘xy  £?T-o-B 


k  i  1  i  oyj  ij 


The  special  case  of  y  =  x  and  B  =  ox  6x  is  the  following  familiar 
in  the  Taylor  expansion 


a2f. 


(f  0  6x  6xT)  =  Y^j  S  5 - tT"  bxi  6xs 

1  XX  'k  i  j  bxi  *yi  1  J 


(A 


Note  that 


f  °  (A  +  B)  =  f  0  A  +  f  0  B 
xy  xy  xy 


(A 


Therefore, 


Vk-1  ~  fx  *  xk-l/k-l  +  fw  *  wk-l  r  2  fxx  xk-l/k-l  xk-l/k-l 


+  ~  f  °  w,  ,  W,  ,  +  f  °  X,  ,  ..  ,  w  .  (A 

2  ww  k-1  k-1  xw  k-l/k-1  k-1 


Therefore,  upon  using  Eq.  (A. 5),  and  since  and  Xjj-l/k-1  are  un 

correlated  and  Efw^^]  =  0,  the  expected  value  of  x^/j^-l  is 


Vk-1  =  E[xk/k-I3  “  fx  *  xk-l/k-l 


if  0  P 
2  xx  j 


Z  =T 

Pk-l/k-l  +  xk-l/k-l  Xk-l/k-l 


+  2  fww  \~l 


(A 


<x  “  x)k/fc-l  =  fx  *  (xk-l/k-l  "  xk-l/k-l>  +  V*  wk-l 


+  I  fKX  ’  I(X  ^ 


k-l/k-1 


+  -  f  0 
+  2  ww 


[; 

[<«  *Vi  -  vi] 


-  (x  x  ) 


-  P. 


k-l/k-1  k-l/k-1 


+  f  °  x.  .  ,  w, 

xw  k-l/k-1  k-1  , 


term 


.7) 


.8) 


.9) 


.10) 


(A. 11) 
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Now  we  compute  the  covariance 


Pk/k-l  =  E  <Xk/k-l  “  xk/k-l)(xk/k-l  "  Xk/k~l*^| 

Pk/k-l  “  E[jXk-l/k-l  "  xk-l/k-l)(xk-l/k-l  "  ’‘k-l/k-l^  J 

+  f  e|wv  .1  fT 

0  v  Lk“l  k_1J  W 


T  T 

a  f  P,  ,  .  f  +  f  Q.  ,  f  , 

x  k-l/k-1  x  w  k-1  w  ’ 


(A.  12) 


where  all  terms  involving  third  or  higher  orders  of  xk~l/k~l  and  wji_i 
are  assumed  to  be  negligible  compared  to  F.  ..  This  is  a  valid 

__  K/K“i  .  g  . 

assumption  when  either  x,  ,  ,  and  w,  ,  are  small  or  (3  f  }/(3x.  3x,  ) 

,  _  .  k-l/k-1  k-1  \  i/  J  k 

and  (o  f.)/(3x.  ew  .)  are  small. 

\  1/  j  0 

For  the  updating  part  of  the  filter,  we  have  (dropping  the  sub¬ 
script  k  on  W  and  h) 


x,  „  a  x,  -  x, 
k/k  k  k/k 


=  Xk  "  txk/k-l  +w(zk  "W3 

=  xk  ’  Vk-1  "  Wh(V  Vk)  4  Wh(xk/k-l' 


Using  a  second-order  approximation  of  h(x^,  v^) ,  we  have 


~  xk/k-l  "  Wj^Xk/k-l>  °>  +  hx(xk  “  ^t/k-l5  +  hv  vk 
4  I  hxx  <xk  “  Xk/k-l) (xk  "  Xk/k-l)  +  2  hvv  °  vk  vk 

t 

+  h*v  "  <xk  -  5k/k-l)  vkJ  *  Wh(Vk-l>  0) 
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XkA  ’  Xk/k 


a  ( I  -  Wh  )  (x  -  x)  -  Wh  v, 
x  v  k 


-  £  Wh 
2  xx 


P'x  X  }k/k-l  "  U  X  ^k/k-1  "  Pk/k-lj 


1  '  T  \  1 

-  Wh  o  tv,  v‘  -  R,  )  -  =■  Wh  °  x 

2  vv  \  k  k  k/  2  xv 


xv  ’  k/k-1  k 


(A. 15) 


Pk/k  ”  E  J^Xk/k  Xk/k^  ^Xk/k  xk/k^ 

—  (.1  ~  Wh^)  Pk/k_1  (I  -  Whx>  +  Whv  Hk  WT  .  (A,  16) 

A  comparison  of  the  actual  covariance  expressions,  Eqs,  (A. 12)  and 
(A. 16),  with  the  computed  covariance  equations  of  the  extended  Kalman 
filter  shows  that  they  are  identical.  The  computed  covariance  equations 
therefore  give  the  actual  covariances  approximated  to  the  second  order. 
However,  the  estimation-error  means  given  in  Eqs.  (A. 10)  and  (A. 14)  are 
no  longer  zero,  as  is  true  in  a  linear  system. 

By  modifying  the  extended  Kalman  filter  equations  of  Eq.  (A. 2), 
the  estimation-error  means  may  be  made  zero.  The  optimality  cf  the 


modified  fi'ter  will  not  bo  discussed  hero.  The  modifications  consists 
of  adding  second-order  torms  as  follows: 


k/k 


-  f  (x  o)  -  i  f  P  -if  on 

-1  "  V  k-l/k-1'  ;  2  xx  k-l/k-1  2  ww  ^k-l 


Vk-1  *  h(  Vk-1>  0> 


xk/k  “  xk/k  -1  ’  2  'V\x  °  Pk/k-l  +  2  Whvv  °  Rk 


x0/-l  “  x0/-l 


(A. 17) 


For 


:•  this  filter,  x^^  i  =  0  and  Xk/k  =  with  the  actual  covariances 
given  by  Eqs.  (A. 12)  and  (A. 16). 
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APPENDIX  B 


THE  VARIATIONAL  EQUATION  Of  THE  COVARIANCE  EQUATIONS 


In  this  appendix,  the  change  in  P,  .  as  a  result  of  changes  in 

K+l/ Kta 


Qk,  will  bo  studied.  For  simplicity  of  notation,  all 


p  6 

k/k’  V 

subscripts  will  be  dropped  on  $  ,  Q  ,  R, 

X  K 


k+i-  an<1  'W 


P.  ,  denotes 
k+1 


Pk+l/k,l'  P  de,10teS  Pk.l/k’  and  Pk  denotes  Pk/k‘ 

The  predict ion -error  covariance  matrix  when  P^,  and  Q  are  changed 
to  +  APk,  $  +  A§,  and  Q  +  AQ.is 


P  +  AP  =  ($  +  A&)  (Pk  +  APk>  ($  +  A§)T  +  (Q  +  AQ) 

=  (?Pk$T  q)  +  A$Pk$T  +  §PkA^T  +  A$PkA$T 
+  (§  -r  A$)  APk  (§  +  A5)T  +  AQ  .  (B.l) 


Since  P  =  $P,  §  +  Q,  we  have 


AP  =  (§A?k§T  +  AQj  +  ^A$Pk$T  +  5PkA$T) 


+  (A5PkA$T  +  A§APk§T  +  §APkA§T 
+  ^A§APkA$T  ) 


(B.2) 


If  A$  =  0,  only  the  first  bracketed  term  is  nonzero.  For  nonzero  A$, 
AP  is  given  to  the  first  order  by  the  first  two  bracketed  terms  of  Eq. 
(3.2)  . 

The  updated  error  covariance  ?k+^  changes  because  of  AP,  AR,  and 
AW.  For  the  general  case  with  no  assumptions  on  AW,  we  have 


P,  ,  +  AP,  ,  «  [I  -  (W  +  AW)H)  [P  *  AP]  Cl  -  (W  +  AW)H3T 

k+1  k+1 

+  <W  +  AW)  (R  +  AR)  (W  +  AW)T  .  (B.3) 


i 
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Upon  subtracting  tho  oxprossion 


< 


PkU  =  £l  -  WH]  P[I  -  WH]T  +  WRWT.  (D.4) 

and  gathering  terns,  we  have 

AP,  ,  =  {(I  -  VfH)  AP(I  -  WH)T  +  WARW7}  +  A.  _  +  B,  ,  ,  (B.5) 

k+1  k+1  k+1  ’ 

where  /  ’ 

I 

A,  ,  s  {[-  (I  ~  WH)  PHT  +  WR]  AWT  +  AWL-  (I  -  WH)  PH*  +  WR]T} 

K4-X  >■ 

Bk+1  "  ^WCHPHT  +  R3  AWT  +£-<!“  WH)  APHT  +  WAR]  AWT 
+  AW[-  (I  -  WH)  APHT  +  WAR)7} 

+  {AW [HAPHT  +  AR]  Aw7} 


The  first  bracketed  term  and  A,  -  contain  the  first-order  terms;  the 

k+1 

B,  ,  is  of  second  and  third  order. 
k+1 

If  the  gain  is  fixed,  AW  s  0,  then  only  the  first  bracketed  term 
is  nonzero . 

If  the  nominal  gain  W  is  optimal  (before  changes  in  P  and  R),  then 
Ak+1  is  zero,  regardless  of  AW,  because 

W°  =  PHT(HPH  +  R)”1  (B.6) 

or 


C-  (I  -  W°H)  PHT  +  W°R]  =  0 


(B.7) 


but  B.  ,  assumes  some  nonzero  value  depending  on  AW. 
k+1 
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Wo  have,  in  fact,  obtained  a  verification  that  W°,  as  shown  in  Eq . 

(B.6),  is  optimum  in  the  sense  that  it  causes  the  smallest  estimation- 

error  covariance.  The  verification  consists  of  showing  that  any  varia- 
o 

tion  from  W  will  result  in  higher  covariance  P^+l/k+l’  Accordingly,  wo 

sot  AP  =0,  AR  =0  in  Eq.  <B.5),  obtaining  the  following  B  that  is 

T  T  14+1 

positive  definite  for  all  AK — AW [HPH  +  R]  AW  .  Therefore,  if  W  of  Eq. 

(B.6)  is  used,  then  A.  ,  is  zero,  and  AP,  ,  =  B,  ,  is  positive  definite. 

’  k+1  ’  k+1  k+1 

This  verifies  the  optimality  of  W  in  Eq.  (B.6). 

Let  y a  now  investigate  the  case  in  which  W  is  arbitrary  but  AW  is 
such  that  (W  +  AW)  is  optimum  under  parameter  variation  P  +  AP  and 
R  +  AS.  We  shall  denote  this  AW  by  AW°.  By  Eq.  (B.6), 

W  +  AW°  =  (P  +  AP)HT  [H(P  +  AP)HT  +  <R  +  AR) l”1  ,  (B.8) 

which  may  be  rearranged  as 


AW°  =  rt2  rr"1 


(B.9) 


where 


TT  a  H(P  +  AP)H  +  a  +  AR 


<?2  =  ( I  -  WK)  (P  +  AP)H  -  W(R  +  AR> 


(B.lO) 


Now  A.  ,  and  B,  ,  may  be  expressed  as 
k+1  k+1 


A,  ,  -r  B,  ,  =  (AW)  tf  (AW) 1  -  n  (AW)T  -  (AW)  n 
k+1  k+1  12  2 


(8.11) 


Using  the  optimum  AW  of  Eq.  (B.9),  we  have 


AK.l  *  Bk+1  =  *2  "I1  4  -  "2  "i1  4  -  "s  "I1  4 


~l  T 
"  “  n2  "l  n2 


(B.12) 
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Therefore,  if  AW  is  used  regardless  of  the  optimality  of  the  nominal  V/, 

A,  ,  +  B,  ,  is  the  negative  definite  matrix  of  Eq .  (B.12). 
k+1  k+1 

Of  particular  interest  is  the  case  when  W  and  W  +  AW  are  both 
optimal: 

APk+1  =  (I  -  W°H)  AP(I  -  W°H)T  +  W°  ARWoT 

-  [-  APHT  +  W°(HAPHT  +  AR) ]  [K(F  +  AP)  HT  +  R  +  AR]"1 


[~  APHT  t-  W(HAPHT  +  ar)]t  , 


(B.13) 


and  when  W  is  fixed,  (AW  =0),  regardless  of  the  optimality  of  W: 


AP,  ,  =  (I  -  WH)  AP( I  -  WH)T  +  WARWT 
k-t-1 


(B.14) 
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APPENDIX  C 


i 

v  . 


NORMALIZATION  OF  THE  COVARIANCE  EQUATION 


The  recursive  covariance  equations  are 


Ti/*-i  • 4*  “j-iA-i 5*  *  «* 


PU  -  "k/k-l  -  pk/k-i  H*T  (H*  ‘t/k-i  a‘T  *  Bk* ) 1  K  K/y-1 


wnere 


p* 

k-l/k-1 


(Px)  (Pxv) 

'  'k-l/k-1  '  'k-l/k-1 

(pJv)  (pv) 

V  XV 'k-l/k-1  '  'k-l/k-1 _ 


§*  = 


1  T* 
0  1 


H*  =  [hl  h23 


Multiplying  both  sides  of  Eq.  (C.l)  by  the  normalization  matrix 


N 


-1/2 


V ~ 


1/k-l 


V  WkZZ_ 


we  obtain  the  following  normalized  equations: 


(C.l) 


(C.2) 


(C  .3) 


(C.4) 


(C  .5) 
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r. 

i 


Rk  =  Cl  0]  N 


-1/2 


A-1  R*  AT“l  [1  0]  N“1/2 

A 


.  (C .12) 


Similar  equations  exist  for  H*  that  aro  matrices  rathor  than  vectors, 
Special  cases  of  H*  ares 


if  H*  =  [1  0]  '  ,  then  H  =  [1  0)  and  R  = 


(p*)k-i/k-i 


if  H*  =  [0  1)  ,  then  K  =  CO  1)  and  R  =  - — r 


if  K*  = 


F  ^ 

,  then  II  ss 

i 

0 

la  i 

i 

0 

1 

and  R  = 


(Pv)k-l/k-l 


R 


;  (C  .13) 


;  (C  .14) 


(Mk-l/k-l 


(Py)k-l/k-l 


(C  .15) 


I.,  N-1/2  Q*  *r1/2  «\ 


xv 


XV 


(V^r^)  (pv\ 

\  v  *  v/k-l/k-l  '  /k-l/k-l 


.  (C .16) 
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